Segment Information - Schedule of Segment Reporting Information (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2020	Jun. 30, 2019	Jun. 30, 2020	Jun. 30, 2019	Dec. 31, 2019
Segment Reporting Information [Line Items]
Net Interest Income	$ 13,541	$ 11,825	$ 26,245	$ 22,182
Provision for loan losses	2,200	179	4,156	310
Noninterest Income	4,843	4,000	9,404	6,334
Noninterest Expenses	13,375	13,014	26,753	22,040
Income taxes	595	531	923	1,230
Segment Profit (Loss)	2,214	2,101	3,817	4,936
Segment Assets	1,777,568	1,506,972	1,777,568	1,506,972	$ 1,515,313
Bank
Segment Reporting Information [Line Items]
Net Interest Income	12,730	11,806	25,386	22,163
Provision for loan losses	2,200	179	4,156	310
Noninterest Income	2,901	3,148	5,950	5,482
Noninterest Expenses	11,045	12,168	22,712	21,194
Income taxes	320	526	688	1,225
Segment Profit (Loss)	2,066	2,081	3,780	4,916
Segment Assets	1,622,608	1,502,974	1,622,608	1,502,974
Mortgage Banking
Segment Reporting Information [Line Items]
Net Interest Income	82	19	116	19
Provision for loan losses	0	0	0	0
Noninterest Income	1,821	852	3,074	852
Noninterest Expenses	1,697	846	2,892	846
Income taxes	43	5	54	5
Segment Profit (Loss)	163	20	244	20
Segment Assets	17,578	3,998	17,578	3,998
Small Business Specialty Lending Division
Segment Reporting Information [Line Items]
Net Interest Income	729	0	743	0
Provision for loan losses	0	0	0	0
Noninterest Income	121	0	380	0
Noninterest Expenses	633	0	1,149	0
Income taxes	232	0	181	0
Segment Profit (Loss)	(15)	0	(207)	0
Segment Assets	$ 137,382	$ 0	$ 137,382	$ 0