Loans Receivable and Allowance For Loan Losses - Loans by Credit Quality Indicator (Details) - USD ($) $ in Thousands	Dec. 31, 2021	Dec. 31, 2020
Financing Receivable, Recorded Investment [Line Items]
Total loans	$ 1,759,026	$ 1,574,227
Pass
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,724,488	1,461,600
Watch
Financing Receivable, Recorded Investment [Line Items]
Total loans	8,856	87,858
Special Mention
Financing Receivable, Recorded Investment [Line Items]
Total loans	7,594	7,122
Substandard
Financing Receivable, Recorded Investment [Line Items]
Total loans	18,088	17,647
Doubtful
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
Loss
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,093,111	925,481
REAL ESTATE LOANS | Commercial
Financing Receivable, Recorded Investment [Line Items]
Total loans	265,038	222,719
REAL ESTATE LOANS | Construction and development
Financing Receivable, Recorded Investment [Line Items]
Total loans	242,433	216,975
REAL ESTATE LOANS | Home equity.
Financing Receivable, Recorded Investment [Line Items]
Total loans	40,558	43,093
REAL ESTATE LOANS | One-to-four-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	366,388	311,093
REAL ESTATE LOANS | Multi-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	178,694	131,601
REAL ESTATE LOANS | Pass
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,078,992	847,809
REAL ESTATE LOANS | Pass | Commercial
Financing Receivable, Recorded Investment [Line Items]
Total loans	253,697	157,932
REAL ESTATE LOANS | Pass | Construction and development
Financing Receivable, Recorded Investment [Line Items]
Total loans	242,433	212,209
REAL ESTATE LOANS | Pass | Home equity.
Financing Receivable, Recorded Investment [Line Items]
Total loans	40,257	42,457
REAL ESTATE LOANS | Pass | One-to-four-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	363,911	303,610
REAL ESTATE LOANS | Pass | Multi-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	178,694	131,601
REAL ESTATE LOANS | Watch
Financing Receivable, Recorded Investment [Line Items]
Total loans	4,652	63,913
REAL ESTATE LOANS | Watch | Commercial
Financing Receivable, Recorded Investment [Line Items]
Total loans	4,652	60,834
REAL ESTATE LOANS | Watch | Construction and development
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	2,917
REAL ESTATE LOANS | Watch | Home equity.
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Watch | One-to-four-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	162
REAL ESTATE LOANS | Watch | Multi-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Total loans	5,772	5,049
REAL ESTATE LOANS | Special Mention | Commercial
Financing Receivable, Recorded Investment [Line Items]
Total loans	5,772	3,013
REAL ESTATE LOANS | Special Mention | Construction and development
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	1,849
REAL ESTATE LOANS | Special Mention | Home equity.
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Special Mention | One-to-four-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	187
REAL ESTATE LOANS | Special Mention | Multi-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Substandard
Financing Receivable, Recorded Investment [Line Items]
Total loans	3,695	8,710
REAL ESTATE LOANS | Substandard | Commercial
Financing Receivable, Recorded Investment [Line Items]
Total loans	917	940
REAL ESTATE LOANS | Substandard | Construction and development
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Substandard | Home equity.
Financing Receivable, Recorded Investment [Line Items]
Total loans	301	636
REAL ESTATE LOANS | Substandard | One-to-four-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	2,477	7,134
REAL ESTATE LOANS | Substandard | Multi-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Doubtful
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Doubtful | Commercial
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Doubtful | Construction and development
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Doubtful | Home equity.
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Doubtful | One-to-four-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Doubtful | Multi-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Loss
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Loss | Commercial
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Loss | Construction and development
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Loss | Home equity.
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Loss | One-to-four-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
REAL ESTATE LOANS | Loss | Multi-family
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS
Financing Receivable, Recorded Investment [Line Items]
Total loans	423,812	375,178
CONSUMER LOANS | Indirect
Financing Receivable, Recorded Investment [Line Items]
Total loans	340,285	286,020
CONSUMER LOANS | Marine
Financing Receivable, Recorded Investment [Line Items]
Total loans	80,627	85,740
CONSUMER LOANS | Other consumer loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	2,900	3,418
CONSUMER LOANS | Pass
Financing Receivable, Recorded Investment [Line Items]
Total loans	423,187	374,307
CONSUMER LOANS | Pass | Indirect
Financing Receivable, Recorded Investment [Line Items]
Total loans	339,734	285,194
CONSUMER LOANS | Pass | Marine
Financing Receivable, Recorded Investment [Line Items]
Total loans	80,571	85,696
CONSUMER LOANS | Pass | Other consumer loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	2,882	3,417
CONSUMER LOANS | Watch
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Watch | Indirect
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Watch | Marine
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Watch | Other consumer loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Special Mention | Indirect
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Special Mention | Marine
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Special Mention | Other consumer loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Substandard
Financing Receivable, Recorded Investment [Line Items]
Total loans	625	871
CONSUMER LOANS | Substandard | Indirect
Financing Receivable, Recorded Investment [Line Items]
Total loans	551	826
CONSUMER LOANS | Substandard | Marine
Financing Receivable, Recorded Investment [Line Items]
Total loans	56	44
CONSUMER LOANS | Substandard | Other consumer loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	18	1
CONSUMER LOANS | Doubtful
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Doubtful | Indirect
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Doubtful | Marine
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Doubtful | Other consumer loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Loss
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Loss | Indirect
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Loss | Marine
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
CONSUMER LOANS | Loss | Other consumer loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
COMMERCIAL BUSINESS LOANS
Financing Receivable, Recorded Investment [Line Items]
Total loans	242,103	273,568
COMMERCIAL BUSINESS LOANS | Commercial and industrial
Financing Receivable, Recorded Investment [Line Items]
Total loans	208,764	224,476
COMMERCIAL BUSINESS LOANS | Warehouse lending
Financing Receivable, Recorded Investment [Line Items]
Total loans	33,339	49,092
COMMERCIAL BUSINESS LOANS | Pass
Financing Receivable, Recorded Investment [Line Items]
Total loans	222,309	239,484
COMMERCIAL BUSINESS LOANS | Pass | Commercial and industrial
Financing Receivable, Recorded Investment [Line Items]
Total loans	188,970	190,392
COMMERCIAL BUSINESS LOANS | Pass | Warehouse lending
Financing Receivable, Recorded Investment [Line Items]
Total loans	33,339	49,092
COMMERCIAL BUSINESS LOANS | Watch
Financing Receivable, Recorded Investment [Line Items]
Total loans	4,204	23,945
COMMERCIAL BUSINESS LOANS | Watch | Commercial and industrial
Financing Receivable, Recorded Investment [Line Items]
Total loans	4,204	23,945
COMMERCIAL BUSINESS LOANS | Watch | Warehouse lending
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
COMMERCIAL BUSINESS LOANS | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,822	2,073
COMMERCIAL BUSINESS LOANS | Special Mention | Commercial and industrial
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,822	2,073
COMMERCIAL BUSINESS LOANS | Special Mention | Warehouse lending
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
COMMERCIAL BUSINESS LOANS | Substandard
Financing Receivable, Recorded Investment [Line Items]
Total loans	13,768	8,066
COMMERCIAL BUSINESS LOANS | Substandard | Commercial and industrial
Financing Receivable, Recorded Investment [Line Items]
Total loans	13,768	8,066
COMMERCIAL BUSINESS LOANS | Substandard | Warehouse lending
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
COMMERCIAL BUSINESS LOANS | Doubtful
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
COMMERCIAL BUSINESS LOANS | Doubtful | Commercial and industrial
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
COMMERCIAL BUSINESS LOANS | Doubtful | Warehouse lending
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
COMMERCIAL BUSINESS LOANS | Loss
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
COMMERCIAL BUSINESS LOANS | Loss | Commercial and industrial
Financing Receivable, Recorded Investment [Line Items]
Total loans	0	0
COMMERCIAL BUSINESS LOANS | Loss | Warehouse lending
Financing Receivable, Recorded Investment [Line Items]
Total loans	$ 0	$ 0