Loans and Leases (Details 5) - USD ($) $ in Thousands		12 Months Ended
		Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, Related Allowance		$ 6,197
Impaired Financing Receivable, Recorded Investment		104,610	$ 97,034
Impaired Financing Receivable, Unpaid Principal Balance		203,934
Impaired Financing Receivable, Average Recorded Investment		79,462
Impaired Financing Receivable, Interest Income, Accrual Method		734
Mortgages [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, Related Allowance		231
Impaired Financing Receivable, Recorded Investment		30,989
Impaired Financing Receivable, Unpaid Principal Balance		48,173
Impaired Financing Receivable, Average Recorded Investment		25,630
Impaired Financing Receivable, Interest Income, Accrual Method		536
Mortgages [Member] | Commercial Real Estate [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with Related Allowance, Recorded Investment		479
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance		479
Impaired Financing Receivable, Related Allowance		71
Impaired Financing Receivable, with No Related Allowance, Recorded Investment		21,264
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance		36,247
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment		479
Impaired Financing Receivable, with Related Allowance, Interest Income, Accrual Method		31
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment		16,252
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method		230
Mortgages [Member] | Residential Real Estate [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with Related Allowance, Recorded Investment		2,002
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance		2,005
Impaired Financing Receivable, Related Allowance		160
Impaired Financing Receivable, with No Related Allowance, Recorded Investment		7,244
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance		9,442
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment		2,001
Impaired Financing Receivable, with Related Allowance, Interest Income, Accrual Method		58
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment		6,898
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method		217
Real Estate Construction [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, Related Allowance		0
Impaired Financing Receivable, Recorded Investment		1,834
Impaired Financing Receivable, Unpaid Principal Balance		1,887
Impaired Financing Receivable, Average Recorded Investment		1,834
Impaired Financing Receivable, Interest Income, Accrual Method		118
Real Estate Construction [Member] | Commercial Real Estate Construction Loan Receivable [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with No Related Allowance, Recorded Investment		1,834
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance		1,887
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment		1,834
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method		118
Commercial Portfolio Segment [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, Related Allowance		5,966
Impaired Financing Receivable, Recorded Investment		71,222
Impaired Financing Receivable, Unpaid Principal Balance		153,146
Impaired Financing Receivable, Average Recorded Investment		51,585
Impaired Financing Receivable, Interest Income, Accrual Method		75
Commercial Portfolio Segment [Member] | Asset Based [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with No Related Allowance, Recorded Investment		30,162
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance		52,139
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment		28,829
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method		0
Commercial Portfolio Segment [Member] | Venture Capital Loans [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with Related Allowance, Recorded Investment		7,811
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance		9,106
Impaired Financing Receivable, Related Allowance		2,581
Impaired Financing Receivable, with No Related Allowance, Recorded Investment		5,270
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance		44,468
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment		7,008
Impaired Financing Receivable, with Related Allowance, Interest Income, Accrual Method		0
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment		4,735
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method		0
Commercial Portfolio Segment [Member] | Other Commercial [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with Related Allowance, Recorded Investment		14,805
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance		15,191
Impaired Financing Receivable, Related Allowance		3,385
Impaired Financing Receivable, with No Related Allowance, Recorded Investment		13,174
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance		32,242
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment		3,710
Impaired Financing Receivable, with Related Allowance, Interest Income, Accrual Method		0
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment		7,303
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method		75
Consumer Portfolio Segment [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, Related Allowance		0
Impaired Financing Receivable, with No Related Allowance, Recorded Investment		565
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance		728
Impaired Financing Receivable, Recorded Investment		565
Impaired Financing Receivable, Unpaid Principal Balance		728
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment		0
Impaired Financing Receivable, with Related Allowance, Interest Income, Accrual Method		0
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment		413
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method		5
Impaired Financing Receivable, Average Recorded Investment		413
Impaired Financing Receivable, Interest Income, Accrual Method		$ 5
Non Purchased Credit Impaired Loans and Leases
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, Related Allowance			4,031
Impaired Financing Receivable, Recorded Investment			97,034
Impaired Financing Receivable, Unpaid Principal Balance			171,923
Impaired Financing Receivable, Average Recorded Investment			81,927	$ 185,740	[1],[2]
Impaired Financing Receivable, Interest Income, Accrual Method			1,052	4,101
Non Purchased Credit Impaired Loans and Leases | Mortgages [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, Related Allowance			417
Impaired Financing Receivable, Recorded Investment			29,329
Impaired Financing Receivable, Unpaid Principal Balance			45,671
Impaired Financing Receivable, Average Recorded Investment			26,840	111,721	[1],[2]
Impaired Financing Receivable, Interest Income, Accrual Method			564	3,643
Non Purchased Credit Impaired Loans and Leases | Mortgages [Member] | Commercial Real Estate [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with Related Allowance, Recorded Investment			1,736
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance			1,648
Impaired Financing Receivable, Related Allowance			170
Impaired Financing Receivable, with No Related Allowance, Recorded Investment			17,783
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance			32,035
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment			1,736	15,538	[1],[2]
Impaired Financing Receivable, with Related Allowance, Interest Income, Accrual Method			72	881
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment			15,714	89,554	[1],[2]
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method			236	2,648
Non Purchased Credit Impaired Loans and Leases | Mortgages [Member] | Residential Real Estate [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with Related Allowance, Recorded Investment			2,569
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance			2,563
Impaired Financing Receivable, Related Allowance			247
Impaired Financing Receivable, with No Related Allowance, Recorded Investment			7,241
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance			9,425
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment			2,199	2,787	[1],[2]
Impaired Financing Receivable, with Related Allowance, Interest Income, Accrual Method			75	55
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment			7,191	3,842	[1],[2]
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method			181	59
Non Purchased Credit Impaired Loans and Leases | Real Estate Construction [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, Related Allowance			0
Impaired Financing Receivable, Recorded Investment			5,862
Impaired Financing Receivable, Unpaid Principal Balance			5,870
Impaired Financing Receivable, Average Recorded Investment			5,460	5,690	[1],[2]
Impaired Financing Receivable, Interest Income, Accrual Method			383	306
Non Purchased Credit Impaired Loans and Leases | Real Estate Construction [Member] | Commercial Real Estate Construction Loan Receivable [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with No Related Allowance, Recorded Investment			5,862
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance			5,870
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment			5,460	5,690	[1],[2]
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method			383	306
Non Purchased Credit Impaired Loans and Leases | Commercial Portfolio Segment [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, Related Allowance			3,614
Impaired Financing Receivable, Recorded Investment			60,695
Impaired Financing Receivable, Unpaid Principal Balance			118,912
Impaired Financing Receivable, Average Recorded Investment			48,783	68,209	[1],[2]
Impaired Financing Receivable, Interest Income, Accrual Method			98	144
Non Purchased Credit Impaired Loans and Leases | Commercial Portfolio Segment [Member] | Asset Based [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with No Related Allowance, Recorded Investment			32,324
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance			38,100
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment	[1],[2]			10,228
Impaired Financing Receivable, with Related Allowance, Interest Income, Accrual Method				0
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment			32,324	2,860	[1],[2]
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method			0	0
Non Purchased Credit Impaired Loans and Leases | Commercial Portfolio Segment [Member] | Venture Capital Loans [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with Related Allowance, Recorded Investment			11,621
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance			13,255
Impaired Financing Receivable, Related Allowance			3,141
Impaired Financing Receivable, with No Related Allowance, Recorded Investment			8,678
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance			41,335
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment			9,449	20,329	[1],[2]
Impaired Financing Receivable, with Related Allowance, Interest Income, Accrual Method			0	60
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment			689	3,404	[1],[2]
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method			0	84
Non Purchased Credit Impaired Loans and Leases | Commercial Portfolio Segment [Member] | Other Commercial [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with Related Allowance, Recorded Investment			473
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance			482
Impaired Financing Receivable, Related Allowance			473
Impaired Financing Receivable, with No Related Allowance, Recorded Investment			7,599
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance			25,740
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment			35
Impaired Financing Receivable, with Related Allowance, Interest Income, Accrual Method			0
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment			6,286
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method			98
Non Purchased Credit Impaired Loans and Leases | Commercial Portfolio Segment [Member] | Cash Flow [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment	[1],[2]			31,388
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method				0
Non Purchased Credit Impaired Loans and Leases | Consumer Portfolio Segment [Member]
Financing Receivable, Credit Quality Indicator [Line Items]
Impaired Financing Receivable, Related Allowance			0
Impaired Financing Receivable, with No Related Allowance, Recorded Investment			1,148
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance			1,470
Impaired Financing Receivable, Recorded Investment			1,148
Impaired Financing Receivable, Unpaid Principal Balance			1,470
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment			0	100	[1],[2]
Impaired Financing Receivable, with Related Allowance, Interest Income, Accrual Method			0	8
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment			844	20	[1],[2]
Impaired Financing Receivable, with No Related Allowance, Interest Income, Accrual Method			7	0
Impaired Financing Receivable, Average Recorded Investment			844	120	[1],[2]
Impaired Financing Receivable, Interest Income, Accrual Method			$ 7	$ 8

[1] Excludes PCI loans. See Note 1(h). Nature of Operations and Summary of Significant Accounting Policies.

[2] For loans and leases reported as impaired at December 31, 2019, 2018, and 2017, amounts were calculated based on the period of time such loans and leases were impaired during the reported period.