Organization and Summary of Significant Accounting Policies - Goodwill and Intangible Assets (Details) - USD ($)	6 Months Ended	12 Months Ended
	Dec. 31, 2022	Jun. 30, 2022
Finite-Lived Intangible Assets [Line Items]
Impairment loss on goodwill	$ 0	$ 0
Core deposit intangible assets, amortization method	using the straight line method
Core Deposits
Finite-Lived Intangible Assets [Line Items]
Intangible assets, gross	$ 17,000,000.0	17,000,000.0
Intangibles assets, accumulated amortization	12,300,000	11,500,000
Remainder of fiscal 2023	803,000
2024	1,600,000
2025	1,100,000
2026	581,000
2027	253,000
Thereafter	417,000
Impairment of intangible assets		0
Other identifiable intangibles
Finite-Lived Intangible Assets [Line Items]
Intangible assets, gross	3,800,000	3,800,000
Intangibles assets, accumulated amortization	3,800,000	3,800,000
Impairment of intangible assets	0
Mortgage and SBA servicing rights
Finite-Lived Intangible Assets [Line Items]
Intangible assets, net	$ 2,600,000	$ 2,700,000
Minimum | Core Deposits
Finite-Lived Intangible Assets [Line Items]
Intangible assets, amortization period	5 years
Maximum | Core Deposits
Finite-Lived Intangible Assets [Line Items]
Intangible assets, amortization period	7 years