Segment Information - Schedule of Segment Reporting Information (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2020	Dec. 31, 2019
Segment Reporting Information [Line Items]
Net Interest Income	$ 55,245	$ 47,845
Provision for loan losses	6,558	1,104
Noninterest Income	24,244	14,004
Noninterest Expenses	58,301	48,136
Income tax benefit	2,815	2,398
Net income/(loss)	11,815	10,211
Total Assets	1,763,974	1,515,313
Bank
Segment Reporting Information [Line Items]
Net Interest Income	54,089	47,681
Provision for loan losses	6,558	1,104
Noninterest Income	13,288	10,865
Noninterest Expenses	46,990	43,666
Income tax benefit	2,653	2,642
Net income/(loss)	11,176	13,217
Total Assets	1,709,696	1,503,284
Mortgage
Segment Reporting Information [Line Items]
Net Interest Income	603	164
Provision for loan losses	0	0
Noninterest Income	9,106	3,139
Noninterest Expenses	8,137	3,257
Income tax benefit	324	10
Net income/(loss)	1,248	36
Total Assets	50,266	11,624
Small Business Specialty Lending Division
Segment Reporting Information [Line Items]
Net Interest Income	553	0
Provision for loan losses	0	0
Noninterest Income	1,850	0
Noninterest Expenses	3,174	1,213
Income tax benefit	(162)	(254)
Net income/(loss)	(609)	(959)
Total Assets	$ 4,012	$ 405