CONSOLIDATED STATEMENTS OF INCOME AND COMPREHENSIVE INCOME (LOSS) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2022	Dec. 31, 2021	Dec. 31, 2020
Interest and dividend income:
Interest and fees on loans	$ 115,080	$ 106,921	$ 111,562
Interest and dividends on taxable securities	5,552	3,977	4,244
Interest and dividends on tax exempt securities	412	463	486
Interest and dividends on other earning assets	2,243	1,782	1,402
Total income	123,287	113,143	117,694
Interest expense:
Interest on deposits	13,281	13,112	20,332
Interest on other borrowings	8,306	5,928	5,807
Total interest expense	21,587	19,040	26,139
Net interest income	101,700	94,103	91,555
Provision for (recovery of) credit losses	11,271	(5,801)	19,450
Net interest income after provision for (recovery of) credit losses	90,429	99,904	72,105
Noninterest income:
Account maintenance and deposit service fees	5,745	7,309	6,520
Income from bank-owned life insurance	1,994	1,687	1,559
Gain on debt extinguishment	0	573
Mortgage banking income	5,054
Gain on sale of other investment	4,144
Realized losses on sales of investment securities			(620)
Consumer Program derivative	65	3
Other noninterest income	1,350	1,566	7,203
Total noninterest income	18,352	11,138	14,662
Noninterest expenses:
Salaries and benefits	49,005	36,741	36,675
Occupancy expenses	5,628	5,956	6,142
Furniture and equipment expenses	5,231	3,622	2,725
Amortization of intangible assets	1,325	1,364	1,364
Virginia franchise tax expense	3,254	2,899	2,457
Data processing expense	6,013	3,850	3,178
Marketing expense	3,067	1,726	1,770
Telephone and communication expense	1,433	1,790	1,497
Net loss on other real estate owned	72	87	960
Loss on bank premises and equipment and assets held for sale	684
Professional fees	4,787	5,467	4,726
Miscellaneous lending expenses	1,710	1,068	1,061
Other operating expenses	9,239	6,906	5,496
Total noninterest expenses	91,448	71,476	68,051
Income from continuing operations before income taxes	17,333	39,566	18,716
Income tax benefit	3,185	8,683	4,140
Income from continuing operations	14,148	30,883	14,576
Income from discontinued operation before income taxes		294	10,789
Income tax expense	3,185	64	2,386
Income from discontinued operation		230	8,403
Net income	14,148	31,113	22,979
Net income	14,148	31,113	22,979
Other comprehensive income (loss):
Unrealized gain (loss) on available-for-sale securities	(34,129)	(3,193)	2,789
Reclassification of loss on sales of investment securities			(620)
Accretion of amounts previously recorded upon transfer to held-to-maturity from available-for-sale		151	12
Net unrealized gain (loss)	(34,129)	(3,042)	3,421
Tax (benefit) expense	(7,167)	(669)	719
Other comprehensive income (loss)	(26,962)	(2,373)	2,702
Comprehensive income (loss)	$ (12,814)	$ 28,740	$ 25,681
Earnings per share from continuing operations, basic (in dollars per share)	$ 0.58	$ 1.26	$ 0.60
Earnings per share from discontinued operation, basic (in dollars per share)	0.00	0.01	0.35
Earnings per share from continuing operations, diluted (in dollars per share)	0.57	1.26	0.60
Earnings per share from discontinued operation, diluted (in dollars per share)	$ 0.00	$ 0.01	$ 0.35