Loans - Aging Analysis of Past Due and Nonaccrual Loans by Class (Details) - USD ($) $ in Thousands	Mar. 31, 2022	Dec. 31, 2021
Financing Receivable, Recorded Investment [Line Items]
Total loans	$ 1,701,384	$ 1,649,448
SBA 504 loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	27,534	27,479
30-59 days past due
Financing Receivable, Recorded Investment [Line Items]
Total loans	5,426	5,619
60-89 days past due
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,193	1,522
90 days and still accruing
Financing Receivable, Recorded Investment [Line Items]
Total loans	549
Nonaccrual
Financing Receivable, Recorded Investment [Line Items]
Total loans	9,301	9,686
Past Due
Financing Receivable, Recorded Investment [Line Items]
Total loans	16,469	16,827
Current
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,684,915	1,632,621
Current | SBA 504 loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	27,534	27,479
SBA loans held for investment
Financing Receivable, Recorded Investment [Line Items]
Total loans	33,048	36,075
SBA loans held for investment | 30-59 days past due
Financing Receivable, Recorded Investment [Line Items]
Total loans		1,558
SBA loans held for investment | Nonaccrual
Financing Receivable, Recorded Investment [Line Items]
Total loans	537	510
SBA loans held for investment | Past Due
Financing Receivable, Recorded Investment [Line Items]
Total loans	537	2,068
SBA loans held for investment | Current
Financing Receivable, Recorded Investment [Line Items]
Total loans	32,511	34,007
SBA PPP loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	28,618	46,450
SBA PPP loans | 60-89 days past due
Financing Receivable, Recorded Investment [Line Items]
Total loans		79
SBA PPP loans | Past Due
Financing Receivable, Recorded Investment [Line Items]
Total loans		79
SBA PPP loans | Current
Financing Receivable, Recorded Investment [Line Items]
Total loans	28,618	46,371
Commercial loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	979,911	931,726
Commercial loans | Real Estate Loan [Member]
Financing Receivable, Recorded Investment [Line Items]
Total loans	728,652	704,674
Commercial loans | Commercial real estate construction
Financing Receivable, Recorded Investment [Line Items]
Total loans	103,380	89,670
Commercial loans | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	120,345	109,903
Commercial loans | 30-59 days past due | Real Estate Loan [Member]
Financing Receivable, Recorded Investment [Line Items]
Total loans	373	334
Commercial loans | 60-89 days past due | Real Estate Loan [Member]
Financing Receivable, Recorded Investment [Line Items]
Total loans		565
Commercial loans | 60-89 days past due | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	28	33
Commercial loans | Nonaccrual | Real Estate Loan [Member]
Financing Receivable, Recorded Investment [Line Items]
Total loans	361	366
Commercial loans | Nonaccrual | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,931	2,216
Commercial loans | Past Due | Real Estate Loan [Member]
Financing Receivable, Recorded Investment [Line Items]
Total loans	734	1,265
Commercial loans | Past Due | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,959	2,249
Commercial loans | Current | Real Estate Loan [Member]
Financing Receivable, Recorded Investment [Line Items]
Total loans	727,918	703,409
Commercial loans | Current | Commercial real estate construction
Financing Receivable, Recorded Investment [Line Items]
Total loans	103,380	89,670
Commercial loans | Current | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	118,386	107,654
Residential mortgage loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	427,165	409,355
Residential mortgage loans | 30-59 days past due
Financing Receivable, Recorded Investment [Line Items]
Total loans	3,772	3,688
Residential mortgage loans | 60-89 days past due
Financing Receivable, Recorded Investment [Line Items]
Total loans	334
Residential mortgage loans | 90 days and still accruing
Financing Receivable, Recorded Investment [Line Items]
Total loans	488
Residential mortgage loans | Nonaccrual
Financing Receivable, Recorded Investment [Line Items]
Total loans	2,999	3,262
Residential mortgage loans | Past Due
Financing Receivable, Recorded Investment [Line Items]
Total loans	7,593	6,950
Residential mortgage loans | Current
Financing Receivable, Recorded Investment [Line Items]
Total loans	419,572	402,405
Consumer loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	77,702	77,944
Consumer loans | Home equity
Financing Receivable, Recorded Investment [Line Items]
Total loans	63,536	65,380
Consumer loans | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	14,166	12,564
Consumer loans | 30-59 days past due | Home equity
Financing Receivable, Recorded Investment [Line Items]
Total loans		39
Consumer loans | 60-89 days past due | Home equity
Financing Receivable, Recorded Investment [Line Items]
Total loans	427
Consumer loans | 90 days and still accruing | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	61
Consumer loans | Nonaccrual | Home equity
Financing Receivable, Recorded Investment [Line Items]
Total loans	200	210
Consumer loans | Past Due | Home equity
Financing Receivable, Recorded Investment [Line Items]
Total loans	627	249
Consumer loans | Past Due | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	61
Consumer loans | Current | Home equity
Financing Receivable, Recorded Investment [Line Items]
Total loans	62,909	65,131
Consumer loans | Current | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	14,105	12,564
Residential construction loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	129,658	120,525
Residential construction loans | 30-59 days past due
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,281
Residential construction loans | 60-89 days past due
Financing Receivable, Recorded Investment [Line Items]
Total loans	404	845
Residential construction loans | Nonaccrual
Financing Receivable, Recorded Investment [Line Items]
Total loans	3,273	3,122
Residential construction loans | Past Due
Financing Receivable, Recorded Investment [Line Items]
Total loans	4,958	3,967
Residential construction loans | Current
Financing Receivable, Recorded Investment [Line Items]
Total loans	124,700	116,558
Total
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,676,102	1,622,075
Total | 30-59 days past due
Financing Receivable, Recorded Investment [Line Items]
Total loans	5,426	5,619
Total | 60-89 days past due
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,193	1,522
Total | 90 days and still accruing
Financing Receivable, Recorded Investment [Line Items]
Total loans	549
Total | Nonaccrual
Financing Receivable, Recorded Investment [Line Items]
Total loans	9,301	9,686
Total | Past Due
Financing Receivable, Recorded Investment [Line Items]
Total loans	16,469	16,827
Total | Current
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,659,633	1,605,248
SBA loans held for sale
Financing Receivable, Recorded Investment [Line Items]
Total loans	25,282	27,373
SBA loans held for sale | Current
Financing Receivable, Recorded Investment [Line Items]
Total loans	$ 25,282	$ 27,373