CONSOLIDATED STATEMENTS OF OPERATIONS - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2020	Dec. 31, 2019	Dec. 31, 2018
Interest income
Loans, including fees	$ 170,960	$ 127,106	$ 95,315
Investment securities:
Taxable interest	37,822	42,286	41,993
Tax-exempt interest	115	170	207
Federal funds sold / securities purchased under agreements to resell			1,708
Interest earning deposits	1,885	10,007	8,737
Total interest income	210,782	179,569	147,960
Interest expense
Deposits	13,281	34,400	25,946
Short-term borrowings	198	3,131	451
Senior debt	1,913
Subordinated debentures	524	750	714
Total interest expense	15,916	38,281	27,111
Net interest income	194,866	141,288	120,849
Provision for credit losses	6,352	4,400	3,585
Net interest income after provision for credit losses	188,514	136,888	117,264
Non-interest income
Prepaid, debit card and related fees	74,465	65,141	54,627
Net realized and unrealized gains (losses) on commercial loans originated for sale	(3,874)	24,072	20,498
Gain on sale of investment securities			41
Gain on sale of IRA portfolio			65,000
Change in value of investment in unconsolidated entity	(45)		(3,689)
Leasing related income	3,294	3,243	3,071
Affinity fees			281
Other	3,646	2,220	1,691
Total non-interest income	84,617	104,127	153,795
Non-interest expense
Salaries and employee benefits	101,737	94,259	79,816
Depreciation and amortization	3,202	3,696	3,997
Rent and related occupancy cost	5,541	6,628	5,474
Data processing expense	4,712	4,894	6,187
Printing and supplies	514	637	906
Audit expense	1,061	1,785	2,002
Legal expense	5,141	5,319	7,845
Amortization of intangible assets	556	1,531	1,531
FDIC insurance	9,808	7,025	8,819
Software	14,028	12,731	13,304
Insurance	2,818	2,475	2,578
Telecom and IT network communications	1,623	1,493	1,373
Securitization and servicing expense		81	117
Consulting	1,361	3,240	3,239
Civil money penalties		8,900	(290)
Prepaid relationship exit expense			672
Lease termination expense		908	395
Other	12,745	12,919	13,313
Total non-interest expense	164,847	168,521	151,278
Income from continuing operations before income taxes	108,284	72,494	119,781
Income tax expense	27,688	21,226	32,241
Net income from continuing operations	80,596	51,268	87,540
Discontinued operations
Income (loss) from discontinued operations before income taxes	(3,816)	510	1,491
Income tax expense (benefit)	(3,304)	219	354
Income (loss) from discontinued operations, net of tax	(512)	291	1,137
Net income	$ 80,084	$ 51,559	$ 88,677
Net income per share from continuing operations - basic	$ 1.40	$ 0.90	$ 1.55
Net income (loss) per share from discontinued operations - basic	(0.01)	0.01	0.02
Net income per share - basic	1.39	0.91	1.57
Net income per share from continuing operations - diluted	1.38	0.89	1.53
Net income (loss) per share from discontinued operations - diluted	(0.01)	0.01	0.02
Net income per share - diluted	$ 1.37	$ 0.90	$ 1.55
Service Fees On Deposit Accounts [Member]
Non-interest income
Non-interest income	$ 30	$ 75	$ 3,622
ACH, Card And Other Payment Processing Fees [Member]
Non-interest income
Non-interest income	$ 7,101	$ 9,376	$ 8,653