Loans and the Allowance for Loan Losses (Details) - Schedule of analysis of impaired loans, by class - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019	Dec. 31, 2019
Financing Receivable, Impaired [Line Items]
No related allowance recorded, Recorded Investment	$ 49,585		$ 49,585		$ 63,193
No related allowance recorded, Unpaid Principal Balance	51,085		51,085		108,804
Impaired loans with No Related Allowance Average Recorded Investment	50,034	$ 61,106	49,425	$ 61,570
Impaired loans with No Related Allowance Interest Income Recognized	231	707	657	1,111
With an allowance recorded, Recorded Investment	28,941		28,941		3,793
With an allowance recorded, Unpaid Principal Balance	74,323		74,323		3,793
With an allowance recorded, Related Allowance	11,349		11,349		1,267
Impaired loans With An Allowance Recorded Average Recorded Investment	28,941	7,083	29,113	7,026
Impaired loans With An Allowance Recorded Interest Income Recognized	5	936	5	229
Total, Recorded Investment	78,526		78,526		66,986
Total, Unpaid Principal Balance	125,408		125,408		112,597
Total, Related Allowance	11,349		11,349		1,267
Total Impaired Loans Average Recorded Investment	78,975	68,189	78,538	68,596
Total Impaired Loans Interest Income Recognized	236	936	662	1,340
Commercial Portfolio Segment [Member]
Financing Receivable, Impaired [Line Items]
No related allowance recorded, Recorded Investment	12,185		12,185		37,984
No related allowance recorded, Unpaid Principal Balance	12,588		12,588		83,225
Impaired loans with No Related Allowance Average Recorded Investment	12,266	41,332	12,100	41,731
Impaired loans with No Related Allowance Interest Income Recognized	50	570	150	733
With an allowance recorded, Recorded Investment	23,024		23,024
With an allowance recorded, Unpaid Principal Balance	68,406		68,406
With an allowance recorded, Related Allowance	10,000		10,000
Impaired loans With An Allowance Recorded Average Recorded Investment	23,024	392	23,195	393
Impaired loans With An Allowance Recorded Interest Income Recognized
Total, Recorded Investment	35,209		35,209		37,984
Total, Unpaid Principal Balance	80,994		80,994		83,225
Total, Related Allowance	10,000		10,000
Total Impaired Loans Average Recorded Investment	35,290	41,332	35,295	41,731
Total Impaired Loans Interest Income Recognized	50	570	150	733
Commercial Real Estate Portfolio Segment [Member]
Financing Receivable, Impaired [Line Items]
No related allowance recorded, Recorded Investment	12,400		12,400		15,249
No related allowance recorded, Unpaid Principal Balance	12,696		12,696		15,467
Impaired loans with No Related Allowance Average Recorded Investment	12,460	12,178	12,415	12,213
Impaired loans with No Related Allowance Interest Income Recognized	74	79	229	221
With an allowance recorded, Recorded Investment	2,722		2,722
With an allowance recorded, Unpaid Principal Balance	2,722		2,722
With an allowance recorded, Related Allowance	1,000		1,000
Impaired loans With An Allowance Recorded Average Recorded Investment	2,722	392	2,722	393
Impaired loans With An Allowance Recorded Interest Income Recognized
Total, Recorded Investment	15,122		15,122		15,249
Total, Unpaid Principal Balance	15,418		15,418		15,467
Total, Related Allowance	1,000		1,000
Total Impaired Loans Average Recorded Investment	15,182	12,570	15,137	12,606
Total Impaired Loans Interest Income Recognized	74	79	229	221
Commercial Construction Portfolio Segment [Member]
Financing Receivable, Impaired [Line Items]
No related allowance recorded, Recorded Investment	21,019		21,019		8,649
No related allowance recorded, Unpaid Principal Balance	21,490		21,490		8,649
Impaired loans with No Related Allowance Average Recorded Investment	21,297	6,044	21,149	6,047
Impaired loans with No Related Allowance Interest Income Recognized	91	58	262	138
With an allowance recorded, Recorded Investment	2,934		2,934		3,530
With an allowance recorded, Unpaid Principal Balance	2,934		2,934		3,530
With an allowance recorded, Related Allowance	302		302		1,244
Impaired loans With An Allowance Recorded Average Recorded Investment	2,934	6,439	2,934	6,378
Impaired loans With An Allowance Recorded Interest Income Recognized		220		220
Total, Recorded Investment	23,953		23,953		12,179
Total, Unpaid Principal Balance	24,424		24,424		12,179
Total, Related Allowance	302		302		1,244
Total Impaired Loans Average Recorded Investment	24,231	12,483	24,083	12,425
Total Impaired Loans Interest Income Recognized	91	278	262	358
Residential Real Estate Portfolio Segment [Member]
Financing Receivable, Impaired [Line Items]
No related allowance recorded, Recorded Investment	3,981		3,981		1,311
No related allowance recorded, Unpaid Principal Balance	4,311		4,311		1,463
Impaired loans with No Related Allowance Average Recorded Investment	4,011	1,552	3,761	1,579
Impaired loans with No Related Allowance Interest Income Recognized	16		16	19
With an allowance recorded, Recorded Investment	261		261		263
With an allowance recorded, Unpaid Principal Balance	261		261		263
With an allowance recorded, Related Allowance	47		47		23
Impaired loans With An Allowance Recorded Average Recorded Investment	261	252	262	255
Impaired loans With An Allowance Recorded Interest Income Recognized	5	9	5	9
Total, Recorded Investment	4,242		4,242		1,574
Total, Unpaid Principal Balance	4,572		4,572		1,726
Total, Related Allowance	47		47		23
Total Impaired Loans Average Recorded Investment	4,272	1,804	4,023	1,834
Total Impaired Loans Interest Income Recognized	$ 21	$ 9	$ 21	$ 28
Consumer Portfolio Segment [Member]
Financing Receivable, Impaired [Line Items]
No related allowance recorded, Recorded Investment
No related allowance recorded, Unpaid Principal Balance
Total, Recorded Investment
Total, Unpaid Principal Balance
Total, Related Allowance