Organization and Summary of Significant Accounting Policies - Intangible Assets (Details) - USD ($)	12 Months Ended
	Jun. 30, 2021	Jun. 30, 2020	Jun. 30, 2019
Finite-Lived Intangible Assets [Line Items]
Amortization of intangible assets	$ 1,395,000	$ 1,771,000	$ 1,672,000
Mortgage Servicing Rights	1,900,000	1,100,000
2022	1,400,000
2023	1,400,000
2024	1,400,000
2025	807,000
2026	328,000
Thereafter	$ 0
Finite-Lived Intangible Assets, Amortization Method	using the straight line method
Gross Core Deposit Intangibles		15,300,000
Gross Core Deposit Intangibles Accumulated Amortization	$ 10,100,000	8,700,000
Gross Other Identifiable Intangibles	3,800,000	3,800,000
Gross Other Identifiable Intangibles Accumulated Amortization	3,800,000	$ 3,800,000
Impairment of Intangible Assets, Finite-lived	0
Goodwill, Impairment Loss	0
Core Deposits
Finite-Lived Intangible Assets [Line Items]
Intangible assets	$ 15,300,000
Minimum
Finite-Lived Intangible Assets [Line Items]
Core deposit intangible assets amortized period	5 years
Maximum
Finite-Lived Intangible Assets [Line Items]
Core deposit intangible assets amortized period	7 years