Loans and Allowance for Credit Losses on Loans - Breakdown Between Loans Identified as CDAs and Non-CDAs (Details) - USD ($) $ in Thousands	Jun. 30, 2022	Jun. 30, 2021
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	$ 2,769,295	$ 2,733,267
Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	1,370,105	1,321,703
Commercial real estate | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	291,202	179,427
Commercial real estate | Commercial Real Estate Loan, Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	335,658	324,350
Commercial real estate | Commercial Real Estate Loan, Non-Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	662,159	727,361
Commercial real estate | Multifamily
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	81,086	90,565
Commercial
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	717,620	646,332
Commercial | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	192,652	141,341
Commercial | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	394,541	317,920
Commercial | Municipal Loans
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	129,766	140,421
Commercial | PPP Loan
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	661	46,650
Residential Portfolio Segment
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	596,187	641,777
Residential Portfolio Segment | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	81,847	66,027
Residential Portfolio Segment | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	354,203	406,549
Residential Portfolio Segment | HELOCs
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	160,137	169,201
Consumer
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	85,383	123,455
Residential Property
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	1,318	807
Total collateral value	2,443	1,160
Residential Property | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Commercial real estate | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Commercial real estate | Commercial Real Estate Loan, Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Commercial real estate | Commercial Real Estate Loan, Non-Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Commercial real estate | Multifamily
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Commercial
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Commercial | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Commercial | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Commercial | Municipal Loans
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Commercial | PPP Loan
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Residential Portfolio Segment
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	1,318	807
Residential Property | Residential Portfolio Segment | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Residential Portfolio Segment | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	1,318	807
Residential Property | Residential Portfolio Segment | HELOCs
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Residential Property | Consumer
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	3,501
Total collateral value	0	3,602
Investment Property | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	3,501
Investment Property | Commercial real estate | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	80
Investment Property | Commercial real estate | Commercial Real Estate Loan, Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property | Commercial real estate | Commercial Real Estate Loan, Non-Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property | Commercial real estate | Multifamily
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	3,421
Investment Property | Commercial
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property | Commercial | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property | Commercial | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property | Commercial | Municipal Loans
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property | Commercial | PPP Loan
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property | Residential Portfolio Segment
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property | Residential Portfolio Segment | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property | Residential Portfolio Segment | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property | Residential Portfolio Segment | HELOCs
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Investment Property | Consumer
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	2,308
Total collateral value	0	2,723
Commercial Property | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	2,308
Commercial Property | Commercial real estate | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Commercial real estate | Commercial Real Estate Loan, Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	2,308
Commercial Property | Commercial real estate | Commercial Real Estate Loan, Non-Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Commercial real estate | Multifamily
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Commercial
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Commercial | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Commercial | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Commercial | Municipal Loans
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Commercial | PPP Loan
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Residential Portfolio Segment
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Residential Portfolio Segment | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Residential Portfolio Segment | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Residential Portfolio Segment | HELOCs
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Commercial Property | Consumer
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Business Assets
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	2,594	300
Total collateral value	69	301
Business Assets | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Business Assets | Commercial real estate | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Business Assets | Commercial real estate | Commercial Real Estate Loan, Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Business Assets | Commercial real estate | Commercial Real Estate Loan, Non-Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0
Business Assets | Commercial real estate | Multifamily
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Business Assets | Commercial
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	2,594	300
Business Assets | Commercial | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	2,594	25
Business Assets | Commercial | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	275
Business Assets | Commercial | Municipal Loans
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Business Assets | Commercial | PPP Loan
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Business Assets | Residential Portfolio Segment
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Business Assets | Residential Portfolio Segment | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Business Assets | Residential Portfolio Segment | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Business Assets | Residential Portfolio Segment | HELOCs
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Business Assets | Consumer
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	0	0
Financial Assets Not Considered Collateral Dependent
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	2,765,383	2,726,351
Financial Assets Not Considered Collateral Dependent | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	1,370,105	1,315,894
Financial Assets Not Considered Collateral Dependent | Commercial real estate | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	291,202	179,347
Financial Assets Not Considered Collateral Dependent | Commercial real estate | Commercial Real Estate Loan, Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	335,658	322,042
Financial Assets Not Considered Collateral Dependent | Commercial real estate | Commercial Real Estate Loan, Non-Owner Occupied
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	662,159	727,361
Financial Assets Not Considered Collateral Dependent | Commercial real estate | Multifamily
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	81,086	87,144
Financial Assets Not Considered Collateral Dependent | Commercial
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	715,026	646,032
Financial Assets Not Considered Collateral Dependent | Commercial | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	190,058	141,316
Financial Assets Not Considered Collateral Dependent | Commercial | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	394,541	317,645
Financial Assets Not Considered Collateral Dependent | Commercial | Municipal Loans
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	129,766	140,421
Financial Assets Not Considered Collateral Dependent | Commercial | PPP Loan
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	661	46,650
Financial Assets Not Considered Collateral Dependent | Residential Portfolio Segment
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	594,869	640,970
Financial Assets Not Considered Collateral Dependent | Residential Portfolio Segment | Construction and land development
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	81,847	66,027
Financial Assets Not Considered Collateral Dependent | Residential Portfolio Segment | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	352,885	405,742
Financial Assets Not Considered Collateral Dependent | Residential Portfolio Segment | HELOCs
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	160,137	169,201
Financial Assets Not Considered Collateral Dependent | Consumer
Accounts, Notes, Loans and Financing Receivable
Financing Receivable, Excluding Accrued Interest, before Allowance for Credit Loss, Fee, and Loan in Process	$ 85,383	$ 123,455