Loans and the Allowance for Loan Losses (Details) - Schedule of allowance for loan losses - USD ($) $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2019	Sep. 30, 2019	Jun. 30, 2019	Mar. 31, 2019	Dec. 31, 2018	Sep. 30, 2018	Jun. 30, 2018	Mar. 31, 2018	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				$ 34,954				$ 31,748	$ 34,954	$ 31,748	$ 25,744
Loan charge-offs									(5,076)	(18,011)	(239)
Recoveries									315	117	243
Provision for loan losses	$ 500	$ 2,000	$ 1,100	4,500	$ 1,100	$ 1,100	$ 1,100	17,800	8,100	21,100	6,000
Balance	38,293				34,954				38,293	34,954	31,748
Commercial Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				9,875				8,233	9,875	8,233	6,632
Loan charge-offs									(1,029)	(17,066)	(70)
Recoveries									265	109	178
Provision for loan losses									(762)	18,599	1,493
Balance	8,349				9,875				8,349	9,875	8,233
Commercial Real Estate Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				18,847				17,112	18,847	17,112	12,583
Loan charge-offs									(3,470)	(915)	(155)
Recoveries									30		51
Provision for loan losses									5,446	2,650	4,633
Balance	20,853				18,847				20,853	18,847	17,112
Commercial construction [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				4,519				4,747	4,519	4,747	4,789
Loan charge-offs
Recoveries
Provision for loan losses									2,785	(228)	(42)
Balance	7,304				4,519				7,304	4,519	4,747
Residential Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				1,266				1,050	1,266	1,050	958
Loan charge-offs									(557)	(23)
Recoveries									3	2	12
Provision for loan losses									973	237	80
Balance	1,685				1,266				1,685	1,266	1,050
Consumer Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				2				1	2	1	3
Loan charge-offs									(20)	(7)	(14)
Recoveries									17	6	2
Provision for loan losses									4	2	10
Balance	3				2				3	2	1
Unallocated Financing Receivables [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				$ 445				$ 605	445	605	779
Loan charge-offs
Recoveries
Provision for loan losses									(346)	(160)	(174)
Balance	$ 99				$ 445				$ 99	$ 445	$ 605