Loans and Allowance for Credit Losses - Balance in the ACL and the recorded investment in loans (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Dec. 31, 2021	Dec. 31, 2020	Dec. 31, 2021	Dec. 31, 2020
Allowance for credit losses:
Balance, beginning of period	$ 32,543	$ 35,084	$ 33,222	$ 25,139
Impact of CECL adoption				9,333
Provision (benefit) charged to expense		612	(679)	1,385
Losses charged off	(24)	(246)	(68)	(416)
Recoveries	10	21	54	30
Balance, end of period	32,529	35,471	32,529	35,471
Residential Real Estate
Allowance for credit losses:
Balance, beginning of period	10,634	8,629	11,192	4,875
Impact of CECL adoption				3,521
Provision (benefit) charged to expense	123	1,859	(404)	2,112
Losses charged off		(90)	(32)	(110)
Recoveries			1
Balance, end of period	10,757	10,398	10,757	10,398
Construction Real Estate
Allowance for credit losses:
Balance, beginning of period	2,045	1,892	2,170	2,010
Impact of CECL adoption				(121)
Provision (benefit) charged to expense	81	495	(44)	498
Balance, end of period	2,126	2,387	2,126	2,387
Commercial Real Estate
Allowance for credit losses:
Balance, beginning of period	14,883	16,050	14,535	12,132
Impact of CECL adoption				3,856
Provision (benefit) charged to expense	(156)	(811)	192	(750)
Recoveries				1
Balance, end of period	14,727	15,239	14,727	15,239
Consumer loans
Allowance for credit losses:
Balance, beginning of period	873	2,305	916	1,182
Impact of CECL adoption				1,065
Provision (benefit) charged to expense	(40)	(882)	(112)	(823)
Losses charged off	(13)	(67)	(25)	(72)
Recoveries	10	6	51	10
Balance, end of period	830	1,362	830	1,362
Commercial loans
Allowance for credit losses:
Balance, beginning of period	4,108	6,208	4,409	4,940
Impact of CECL adoption				1,012
Provision (benefit) charged to expense	(8)	(49)	(311)	348
Losses charged off	(11)	(89)	(11)	(234)
Recoveries		15	2	19
Balance, end of period	$ 4,089	$ 6,085	$ 4,089	$ 6,085