Loans and Allowance for Credit Losses - Balance in the ACL and the recorded investment in loans (Details) - USD ($)	3 Months Ended		9 Months Ended
	Mar. 31, 2022	Mar. 31, 2021	Mar. 31, 2022	Mar. 31, 2021
Allowance for credit losses:
Balance, beginning of period	$ 32,529,000	$ 35,471,000	$ 33,222,000	$ 25,139,000
Impact of CECL adoption				9,333,000
Initial ACL on PCD loans	120,000		120,000
Provision (benefit) charged to expense	1,052,000		373,000	1,385,000
Losses charged off	(68,000)	(258,000)	(136,000)	(674,000)
Recoveries	8,000	14,000	62,000	44,000
Balance, end of period	33,641,000	35,227,000	33,641,000	35,227,000
Negative PCL	(468,000)
Residential Real Estate
Allowance for credit losses:
Balance, beginning of period	10,757,000	10,398,000	11,192,000	4,875,000
Impact of CECL adoption				3,521,000
Initial ACL on PCD loans	23,000		23,000
Provision (benefit) charged to expense	434,000	(576,000)	30,000	1,536,000
Losses charged off	(30,000)	(68,000)	(62,000)	(178,000)
Recoveries	2,000	1,000	3,000	1,000
Balance, end of period	11,186,000	9,755,000	11,186,000	9,755,000
Construction Real Estate
Allowance for credit losses:
Balance, beginning of period	2,126,000	2,387,000	2,170,000	2,010,000
Impact of CECL adoption				(121,000)
Initial ACL on PCD loans	4,000		4,000
Provision (benefit) charged to expense	(143,000)	(369,000)	(187,000)	129,000
Balance, end of period	1,987,000	2,018,000	1,987,000	2,018,000
Commercial Real Estate
Allowance for credit losses:
Balance, beginning of period	14,727,000	15,239,000	14,535,000	12,132,000
Impact of CECL adoption				3,856,000
Initial ACL on PCD loans	52,000		52,000
Provision (benefit) charged to expense	771,000	2,070,000	963,000	1,319,000
Losses charged off		(91,000)		(90,000)
Recoveries				1,000
Balance, end of period	15,550,000	17,218,000	15,550,000	17,218,000
Consumer loans
Allowance for credit losses:
Balance, beginning of period	830,000	1,362,000	916,000	1,182,000
Impact of CECL adoption				1,065,000
Provision (benefit) charged to expense	19,000	(107,000)	(93,000)	(929,000)
Losses charged off	(32,000)	(57,000)	(57,000)	(130,000)
Recoveries	6,000	6,000	57,000	16,000
Balance, end of period	823,000	1,204,000	823,000	1,204,000
Commercial loans
Allowance for credit losses:
Balance, beginning of period	4,089,000	6,085,000	4,409,000	4,940,000
Impact of CECL adoption				1,012,000
Initial ACL on PCD loans	41,000		41,000
Provision (benefit) charged to expense	(29,000)	(1,018,000)	(340,000)	(670,000)
Losses charged off	(6,000)	(42,000)	(17,000)	(276,000)
Recoveries		7,000	2,000	26,000
Balance, end of period	$ 4,095,000	$ 5,032,000	$ 4,095,000	$ 5,032,000