Segment Information - Schedule of Segment Reporting Information (Details) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2021 USD ($) employee	Jun. 30, 2020 USD ($) employee	Jun. 30, 2021 USD ($) employee	Jun. 30, 2020 USD ($) employee	Dec. 31, 2020 USD ($)
Segment Reporting Information [Line Items]
Net Interest Income	$ 15,069	$ 13,541	$ 29,300	$ 26,245
Provision for loan losses	0	2,200	500	4,156
Noninterest Income	7,751	4,843	16,352	9,404
Noninterest Expenses	17,465	13,375	33,219	26,753
Income Taxes	1,358	595	3,016	923
Segment Profit (Loss)	3,997	$ 2,214	8,917	$ 3,817
Segment assets	$ 1,755,518		$ 1,755,518		$ 1,763,974
Full time employees | employee	365	374	365	374
Bank
Segment Reporting Information [Line Items]
Net Interest Income	$ 14,864	$ 13,440	$ 28,797	$ 26,096
Provision for loan losses	0	2,200	500	4,156
Noninterest Income	3,354	2,901	6,384	5,950
Noninterest Expenses	13,366	10,158	25,298	21,825
Income Taxes	1,241	842	2,401	1,210
Segment Profit (Loss)	3,611	$ 3,141	6,982	$ 4,855
Segment assets	$ 1,710,345		$ 1,710,345		1,709,696
Full time employees | employee	291	321	291	321
Mortgage Banking
Segment Reporting Information [Line Items]
Net Interest Income	$ 123	$ 82	$ 291	$ 116
Provision for loan losses	0	0	0	0
Noninterest Income	2,997	1,821	6,983	3,074
Noninterest Expenses	2,887	1,697	5,680	2,892
Income Taxes	60	43	414	54
Segment Profit (Loss)	173	$ 163	1,180	$ 244
Segment assets	$ 25,149		$ 25,149		50,266
Full time employees | employee	51	40	51	40
Small Business Specialty Lending Division
Segment Reporting Information [Line Items]
Net Interest Income	$ 82	$ 19	$ 212	$ 33
Provision for loan losses	0	0	0	0
Noninterest Income	1,400	121	2,985	380
Noninterest Expenses	1,212	1,520	2,241	2,036
Income Taxes	57	(290)	201	(341)
Segment Profit (Loss)	213	$ (1,230)	755	$ (1,695)
Segment assets	$ 20,024		$ 20,024		$ 4,012
Full time employees | employee	23	13	23	13