Segment Information - Schedule of Segment Reporting Information (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019	Dec. 31, 2019
Segment Reporting Information [Line Items]
Net Interest Income	$ 13,848	$ 12,656	$ 40,094	$ 34,854
Provision for loan losses	1,106	214	5,262	524
Noninterest Income	7,554	4,030	16,829	10,350
Noninterest Expenses	16,313	13,357	42,938	35,398
Income Taxes	884	597	1,807	1,827
Segment Profit (Loss)	3,099	2,518	6,916	7,455
Segment Assets	1,759,446	1,477,682	1,759,446	1,477,682	$ 1,515,313
Bank
Segment Reporting Information [Line Items]
Net Interest Income	12,920	12,575	38,306	34,754
Provision for loan losses	1,106	214	5,262	524
Noninterest Income	4,139	2,785	9,960	8,462
Noninterest Expenses	13,242	11,637	36,712	32,832
Income Taxes	785	501	1,472	1,726
Segment Profit (Loss)	1,926	3,008	4,820	8,134
Segment Assets	1,563,131	1,473,535	1,563,131	1,473,535
Mortgage Banking
Segment Reporting Information [Line Items]
Net Interest Income	188	81	305	100
Provision for loan losses	0	0	0	0
Noninterest Income	2,612	1,245	5,686	1,888
Noninterest Expenses	2,410	1,191	5,302	2,037
Income Taxes	82	(15)	137	(10)
Segment Profit (Loss)	308	150	552	(39)
Segment Assets	50,265	3,998	50,265	3,998
Small Business Specialty Lending Division
Segment Reporting Information [Line Items]
Net Interest Income	740	0	1,483	0
Provision for loan losses	0	0	0	0
Noninterest Income	803	0	1,183	0
Noninterest Expenses	661	529	924	529
Income Taxes	17	111	198	111
Segment Profit (Loss)	865	(640)	1,544	(640)
Segment Assets	$ 146,050	$ 149	$ 146,050	$ 149