Organization and Summary of Significant Accounting Policies - Intangible Assets, Finite-Lived (Details) - USD ($)	9 Months Ended	12 Months Ended
	Mar. 31, 2021	Jun. 30, 2020
Finite-Lived Intangible Assets [Line Items]
Finite-Lived Core Deposits, Gross	$ 15,300,000	$ 15,300,000
Finite-Lived Intangible Assets, Accumulated Amortization	9,700,000	8,700,000
Other Finite-Lived Intangible Assets, Gross	3,800,000	3,800,000
Other Finite Lived Intangible Assets Gross Accumulated Amortization	3,800,000	3,800,000
Amortization of Mortgage Servicing Rights (MSRs)	1,500,000	1,100,000
Remainder of fiscal 2021	338,000
2022	1,400,000
2023	1,400,000
2024	1,400,000
2025	807,000
Thereafter	328,000
Impairment of Intangible Assets, Finite-lived	$ 0	$ 0
Minimum
Finite-Lived Intangible Assets [Line Items]
Core Deposits and Intangible Assets, Remaining Amortization Period	P5Y
Maximum
Finite-Lived Intangible Assets [Line Items]
Core Deposits and Intangible Assets, Remaining Amortization Period	P7Y