Loans and the Allowance for Loan Losses (Details) - Schedule of allowance for loan losses - USD ($) $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2020	Sep. 30, 2020	Jun. 30, 2020	Mar. 31, 2020	Dec. 31, 2019	Sep. 30, 2019	Jun. 30, 2019	Mar. 31, 2019	Dec. 31, 2020	Dec. 31, 2019	Dec. 31, 2018
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				$ 38,293				$ 34,954	$ 38,293	$ 34,954	$ 31,748
Loan charge-offs									(900)	(5,076)	(18,011)
Recoveries									833	315	117
Provision for loan losses	$ 5,000	$ 5,000	$ 15,000	16,000	$ 500	$ 2,000	$ 1,100	4,500	41,000	8,100	21,100
Balance	79,226				38,293				79,226	38,293	34,954
Commercial Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				8,349				9,875	8,349	9,875	8,233
Loan charge-offs									(552)	(1,029)	(17,066)
Recoveries									4	265	109
Provision for loan losses									20,642	(762)	18,599
Balance	28,443				8,349				28,443	8,349	9,875
Commercial Real Estate Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				20,853				18,847	20,853	18,847	17,112
Loan charge-offs										(3,470)	(915)
Recoveries									802	30
Provision for loan losses									17,675	5,446	2,650
Balance	39,330				20,853				39,330	20,853	18,847
Commercial construction [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				7,304				4,519	7,304	4,519	4,747
Loan charge-offs
Recoveries
Provision for loan losses									890	2,785	(228)
Balance	8,194				7,304				8,194	7,304	4,519
Residential Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				1,685				1,266	1,685	1,266	1,050
Loan charge-offs									(341)	(557)	(23)
Recoveries									23	3	2
Provision for loan losses									1,320	973	237
Balance	2,687				1,685				2,687	1,685	1,266
Consumer Portfolio Segment [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				3				2	3	2	1
Loan charge-offs									(7)	(20)	(7)
Recoveries									4	17	6
Provision for loan losses									4	4	2
Balance	4				3				4	3	2
Unallocated Financing Receivables [Member]
Financing Receivable, Allowance for Credit Loss [Line Items]
Balance				$ 99				$ 445	99	445	605
Loan charge-offs
Recoveries
Provision for loan losses									469	(346)	(160)
Balance	$ 568				$ 99				$ 568	$ 99	$ 445