Segment Information - Schedule of Segment Reporting Information (Details) $ in Thousands	3 Months Ended
	Mar. 31, 2021 USD ($) employee	Mar. 31, 2020 USD ($) employee	Dec. 31, 2020 USD ($)
Segment Reporting Information [Line Items]
Net Interest Income	$ 14,283	$ 12,704
Provision	500	1,956
Noninterest Income	8,576	4,526
Noninterest Expenses	15,782	13,343
Income Taxes	1,658	328
Segment Profit (Loss)	4,919	1,603
Segment Assets	$ 1,799,046	$ 1,763,974	$ 1,763,974
Full time employees | employee	365	365
Bank
Segment Reporting Information [Line Items]
Net Interest Income	$ 13,985	$ 12,656
Provision	500	1,956
Noninterest Income	3,005	3,014
Noninterest Expenses	11,960	11,632
Income Taxes	1,160	368
Segment Profit (Loss)	3,370	1,714
Segment Assets	$ 1,755,667	$ 1,709,696
Full time employees | employee	291	319
Mortgage Banking
Segment Reporting Information [Line Items]
Net Interest Income	$ 168	$ 34
Provision	0	0
Noninterest Income	3,986	1,253
Noninterest Expenses	2,793	1,195
Income Taxes	354	11
Segment Profit (Loss)	1,007	81
Segment Assets	$ 27,478	$ 50,266
Full time employees | employee	51	34
Small Business Specialty Lending Division
Segment Reporting Information [Line Items]
Net Interest Income	$ 130	$ 14
Provision	0	0
Noninterest Income	1,585	259
Noninterest Expenses	1,029	516
Income Taxes	144	(51)
Segment Profit (Loss)	542	(465)
Segment Assets	$ 15,901	$ 4,012
Full time employees | employee	23	12