Fair Value of Financial Instruments - Schedule of Fair Value, by Balance Sheet Grouping (Details) - USD ($) $ in Thousands	Sep. 30, 2023	Jun. 30, 2023
Fair Value, Inputs, Level 1 | Cash and interest-bearing deposits
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	$ 325,014	$ 303,497
Fair Value, Inputs, Level 1 | Certificates of deposit in other banks
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Securities available for sale
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Small Business Investment Company Funds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Loans held for sale, at fair value
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	4,616	6,947
Fair Value, Inputs, Level 1 | Loans held for sale, at the lower of cost or fair value
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Loans, net
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Accrued interest receivable
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	283	99
Fair Value, Inputs, Level 1 | Noninterest-bearing and NOW deposits
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Money market accounts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Savings accounts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Certificates of deposit
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Junior Subordinated Debt
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Other borrowings
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Accrued interest payable
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Cash and interest-bearing deposits
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Certificates of deposit in other banks
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	35,380	33,152
Fair Value, Inputs, Level 2 | Securities available for sale
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	134,348	151,926
Fair Value, Inputs, Level 2 | Small Business Investment Company Funds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Loans held for sale, at fair value
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Loans held for sale, at the lower of cost or fair value
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Loans, net
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Accrued interest receivable
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	482	410
Fair Value, Inputs, Level 2 | Noninterest-bearing and NOW deposits
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	1,430,166	1,436,586
Fair Value, Inputs, Level 2 | Money market accounts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	1,195,482	1,241,840
Fair Value, Inputs, Level 2 | Savings accounts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	202,971	212,220
Fair Value, Inputs, Level 2 | Certificates of deposit
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	805,646	701,965
Fair Value, Inputs, Level 2 | Junior Subordinated Debt
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	9,864	9,746
Fair Value, Inputs, Level 2 | Other borrowings
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	452,239	457,213
Fair Value, Inputs, Level 2 | Accrued interest payable
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	6,093	3,537
Fair Value, Inputs, Level 3 | Cash and interest-bearing deposits
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Certificates of deposit in other banks
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Securities available for sale
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Small Business Investment Company Funds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	14,586	14,927
Fair Value, Inputs, Level 3 | Loans held for sale, at fair value
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Loans held for sale, at the lower of cost or fair value
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	203,333	163,874
Fair Value, Inputs, Level 3 | Loans, net
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	3,436,553	3,455,390
Fair Value, Inputs, Level 3 | Accrued interest receivable
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	15,748	14,320
Fair Value, Inputs, Level 3 | Noninterest-bearing and NOW deposits
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Money market accounts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Savings accounts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Certificates of deposit
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Junior Subordinated Debt
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Other borrowings
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Accrued interest payable
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	0	0
Carrying Value | Cash and interest-bearing deposits
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	325,014	303,497
Carrying Value | Certificates of deposit in other banks
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	35,380	33,152
Carrying Value | Securities available for sale
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	134,348	151,926
Carrying Value | FHLB Stock
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	19,612	20,208
Carrying Value | Small Business Investment Company Funds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	14,586	14,927
Carrying Value | Loans held for sale, at fair value
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	4,616	6,947
Carrying Value | Loans held for sale, at the lower of cost or fair value
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	200,834	161,703
Carrying Value | Loans, net
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	3,612,497	3,611,630
Carrying Value | Accrued interest receivable
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	16,513	14,829
Carrying Value | Noninterest-bearing and NOW deposits
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	1,430,166	1,436,586
Carrying Value | Money market accounts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	1,195,482	1,241,840
Carrying Value | Savings accounts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	202,971	212,220
Carrying Value | Certificates of deposit
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	812,342	710,522
Carrying Value | Junior Subordinated Debt
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	9,995	9,971
Carrying Value | Other borrowings
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	452,263	457,263
Carrying Value | Accrued interest payable
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	6,093	3,537
Fair Value | Cash and interest-bearing deposits
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	325,014	303,497
Fair Value | Certificates of deposit in other banks
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	35,380	33,152
Fair Value | Securities available for sale
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	134,348	151,926
Fair Value | Small Business Investment Company Funds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	14,586	14,927
Fair Value | Loans held for sale, at fair value
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	4,616	6,947
Fair Value | Loans held for sale, at the lower of cost or fair value
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	203,333	163,874
Fair Value | Loans, net
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	3,436,553	3,455,390
Fair Value | Accrued interest receivable
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	16,513	14,829
Fair Value | Noninterest-bearing and NOW deposits
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	1,430,166	1,436,586
Fair Value | Money market accounts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	1,195,482	1,241,840
Fair Value | Savings accounts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	202,971	212,220
Fair Value | Certificates of deposit
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	805,646	701,965
Fair Value | Junior Subordinated Debt
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	9,864	9,746
Fair Value | Other borrowings
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	452,239	457,213
Fair Value | Accrued interest payable
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Financial Instruments Owned	$ 6,093	$ 3,537