Organization and Summary of Significant Accounting Policies - Goodwill and Intangible Assets (Details) - USD ($)	12 Months Ended
	Jun. 30, 2022	Jun. 30, 2021
Finite-Lived Intangible Assets [Line Items]
Impairment loss on goodwill	$ 0
Core deposit intangible assets, amortization method	using the straight line method
Impairment of intangible assets	$ 0	$ 0
Core Deposits
Finite-Lived Intangible Assets [Line Items]
Intangible assets, gross	17,000,000.0	15,300,000
Intangibles assets, accumulated amortization	11,500,000	10,100,000
2023	1,600,000
2024	1,600,000
2025	1,100,000
2026	581,000
2027	253,000
Thereafter	417,000
Other identifiable intangibles
Finite-Lived Intangible Assets [Line Items]
Intangible assets, gross	3,800,000	3,800,000
Intangibles assets, accumulated amortization	3,800,000	3,800,000
Mortgage and SBA servicing rights
Finite-Lived Intangible Assets [Line Items]
Intangible assets, net	$ 2,700,000	$ 1,900,000
Minimum
Finite-Lived Intangible Assets [Line Items]
Intangible assets, amortization period	5 years
Maximum
Finite-Lived Intangible Assets [Line Items]
Intangible assets, amortization period	7 years