Loans - Classification of Loans By Class (Details) - USD ($) $ in Thousands	Dec. 31, 2021	Dec. 31, 2020
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	$ 1,649,448	$ 1,627,817
SBA 504 loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	27,479	19,681
SBA loans held for investment
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	36,075	39,587
SBA PPP loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	46,450	118,257
Commercial loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	931,726	839,788
Commercial loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	704,674	630,423
Commercial loans | Commercial real estate construction
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	89,670	71,404
Commercial loans | Consumer other
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	109,903	118,280
Residential mortgage loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	409,355	467,586
Consumer loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	77,944	66,100
Consumer loans | Commercial real estate construction
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	120,525	87,164
Consumer loans | Home equity
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	76,725	62,549
Consumer loans | Consumer other
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	1,219	3,551
Residential construction loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	120,525	87,164
Total
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	1,622,075	1,618,482
SBA loans held for sale
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans	$ 27,373	$ 9,335