Loans and Allowance for Credit Losses on Loans - Changes in the Allowance for Loan Losses (Details) - USD ($)	12 Months Ended
	Dec. 31, 2023	Dec. 31, 2022	Dec. 31, 2021
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning of period balance	$ 47,512,000	$ 43,290,000	$ 44,400,000
Charge-offs	(1,011,000)	(434,000)	(520,000)
Recoveries	708,000	3,890,000	2,544,000
Net (charge-offs) recoveries	(303,000)	3,456,000	2,024,000
Provision for (recapture of) credit losses on loans	749,000	766,000	(3,134,000)
End of period balance	47,958,000	47,512,000	43,290,000
Commercial. | Commercial
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning of period balance	6,617,000	8,414,000	11,587,000
Charge-offs	(750,000)	(434,000)	(520,000)
Recoveries	346,000	427,000	1,354,000
Net (charge-offs) recoveries	(404,000)	(7,000)	834,000
Provision for (recapture of) credit losses on loans	(360,000)	(1,790,000)	(4,007,000)
End of period balance	5,853,000	6,617,000	8,414,000
Real estate | CRE - Owner Occupied
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning of period balance	5,751,000	7,954,000	8,560,000
Recoveries	11,000	15,000	16,000
Net (charge-offs) recoveries	11,000	15,000	16,000
Provision for (recapture of) credit losses on loans	(641,000)	(2,218,000)	(622,000)
End of period balance	5,121,000	5,751,000	7,954,000
Real estate | CRE - Non-Owner Occupied
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning of period balance	22,135,000	17,125,000	16,416,000
Provision for (recapture of) credit losses on loans	3,188,000	5,010,000	709,000
End of period balance	25,323,000	22,135,000	17,125,000
Real estate | Land & Construction
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning of period balance	2,941,000	1,831,000	2,509,000
Recoveries			884,000
Net (charge-offs) recoveries			884,000
Provision for (recapture of) credit losses on loans	(589,000)	1,110,000	(1,562,000)
End of period balance	2,352,000	2,941,000	1,831,000
Real estate | Home Equity
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning of period balance	666,000	864,000	1,297,000
Charge-offs	(246,000)
Recoveries	351,000	105,000	93,000
Net (charge-offs) recoveries	105,000	105,000	93,000
Provision for (recapture of) credit losses on loans	(127,000)	(303,000)	(526,000)
End of period balance	644,000	666,000	864,000
Real estate | Multi-Family
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning of period balance	3,366,000	2,796,000	2,804,000
Provision for (recapture of) credit losses on loans	1,687,000	570,000	(8,000)
End of period balance	5,053,000	3,366,000	2,796,000
Real estate | Residential Mortgage
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning of period balance	5,907,000	4,132,000	943,000
Provision for (recapture of) credit losses on loans	(2,482,000)	1,775,000	3,189,000
End of period balance	3,425,000	5,907,000	4,132,000
Consumer | Consumer and Other
Financing Receivable, Allowance for Credit Losses [Line Items]
Beginning of period balance	129,000	174,000	284,000
Charge-offs	(15,000)
Recoveries		3,343,000	197,000
Net (charge-offs) recoveries	(15,000)	3,343,000	197,000
Provision for (recapture of) credit losses on loans	73,000	(3,388,000)	(307,000)
End of period balance	$ 187,000	$ 129,000	$ 174,000