Loans Receivable and Allowance for Credit Losses - Aging Analysis of Loans (Details) - USD ($) $ in Thousands	Mar. 31, 2023	Dec. 31, 2022
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	$ 1,641,304	$ 1,525,668
Nonaccrual Loans	19,351	13,708
90 Days or More Accruing	2,452	2,973
1-4 Family Investor Owned
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	354,559	343,968
Nonaccrual Loans	3,049	3,061
1-4 Family Residential Owner-Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	149,481	134,878
Nonaccrual Loans	4,265	2,987
Multifamily Residential
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	553,430	494,667
Nonresidential Properties
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	314,560	308,043
Nonaccrual Loans	91	93
Construction and Land
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	235,157	185,018
Nonaccrual Loans	11,906	7,567
Current
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	1,612,140	1,482,970
Current | 1-4 Family Investor Owned
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	350,105	340,495
Current | 1-4 Family Residential Owner-Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	146,929	131,510
Current | Multifamily Residential
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	550,939	490,024
Current | Nonresidential Properties
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	310,591	303,190
Current | Construction and Land
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	223,252	173,351
Financial Asset, 30 to 59 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	8,859	15,705
Financial Asset, 30 to 59 Days Past Due | 1-4 Family Investor Owned
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	2,589	1,530
Financial Asset, 30 to 59 Days Past Due | 1-4 Family Residential Owner-Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	493	2,553
Financial Asset, 30 to 59 Days Past Due | Multifamily Residential
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	1,052	4,643
Financial Asset, 30 to 59 Days Past Due | Nonresidential Properties
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	3,969	4,246
Financing Receivables, 60 to 89 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	545	13,773
Financing Receivables, 60 to 89 Days Past Due | 1-4 Family Investor Owned
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due		78
Financing Receivables, 60 to 89 Days Past Due | Nonresidential Properties
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due		607
Financing Receivables, 60 to 89 Days Past Due | Construction and Land
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due		4,100
Financing Receivables, 90 Days or More Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	19,760	13,220
Financing Receivables, 90 Days or More Past Due | 1-4 Family Investor Owned
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	1,865	1,865
Financing Receivables, 90 Days or More Past Due | 1-4 Family Residential Owner-Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	2,059	815
Financing Receivables, 90 Days or More Past Due | Multifamily Residential
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	1,439
Financing Receivables, 90 Days or More Past Due | Construction and Land
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	11,905	7,567
Business Loans
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	19,890	39,965
Nonaccrual Loans	40
90 Days or More Accruing	2,452	2,973
Business Loans | Current
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	17,393	27,657
Business Loans | Financial Asset, 30 to 59 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	4	1,466
Business Loans | Financing Receivables, 60 to 89 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	1	7,869
Business Loans | Financing Receivables, 90 Days or More Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	2,492	2,973
Consumer
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	14,227	19,129
Consumer | Current
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	12,931	16,743
Consumer | Financial Asset, 30 to 59 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	752	1,267
Consumer | Financing Receivables, 60 to 89 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	$ 544	$ 1,119