Commitments and Contingencies - Narrative (Details) $ in Thousands	12 Months Ended
	Jun. 30, 2023 USD ($) investment	Jun. 30, 2022 USD ($) investment
Loss Contingencies [Line Items]
Undisbursed portions of construction loans	$ 220,818	$ 312,893
Loan commitments	86,393	104,745
Variable rate loan commitments	45,533	23,159
Fixed rate loan commitments	40,860	81,586
Pre-approved but unused lines of credit	608,169	485,239
Committed capital, SBIC investments	$ 24,000	$ 21,000
Number of SBIC investments for committed capital | investment	8	7
Committed capital, SBIC investments, remaining to be drawn	$ 7,984	$ 7,893
Letters of credit outstanding	$ 35,007	$ 18,362
Minimum
Loss Contingencies [Line Items]
Fixed rate interest rate (as a percent)	1.74%	1.41%
Loan commitments terms	3 years
Maximum
Loss Contingencies [Line Items]
Fixed rate interest rate (as a percent)	11.00%	9.00%
Loan commitments terms	30 years