Commitments and Contingencies - Narrative (Details) - USD ($) $ in Thousands	12 Months Ended
	Jun. 30, 2022	Jun. 30, 2021
Loss Contingencies [Line Items]
Undisbursed portions of construction loans	$ 312,893	$ 277,600
Loan commitments	104,745	123,463
Variable rate loan commitments	23,159	45,270
Fixed rate loan commitments	81,586	78,193
Pre-approved but unused lines of credit	485,239	530,505
Letters of credit outstanding	$ 18,362	$ 8,681
Minimum
Loss Contingencies [Line Items]
Fixed rate interest rate (as a percent)	1.41%	2.50%
Loan commitments terms	3 years
Maximum
Loss Contingencies [Line Items]
Fixed rate interest rate (as a percent)	9.00%	8.36%
Loan commitments terms	30 years