Business Segment Information - Operating Statements (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2017	Sep. 30, 2016	Sep. 30, 2017	Sep. 30, 2016	Dec. 31, 2016
Operating Income
Interest income	$ 27,955	$ 23,874	$ 78,759	$ 70,440
Total interest expense	1,634	826	3,679	2,344
Net interest income	26,321	23,048	75,080	68,096
Provision for loan losses	115	245	390	997
Net interest income after provision	26,206	22,803	74,690	67,099
Noninterest income	2,460	2,312	7,048	8,586
Noninterest expense	14,834	14,296	45,416	43,362
Income before income taxes	13,832	10,819	36,322	32,323
Income tax expense	5,249	4,054	13,752	12,157
Net income	8,583	6,765	22,570	20,166
Total assets	2,843,948	2,527,962	2,843,948	2,527,962	$ 2,570,880
Loans, net of deferred fees	1,565,950	1,450,176	1,565,950	1,450,176	1,502,607
Goodwill	45,664	45,664	45,664	45,664	$ 45,664
Banking
Operating Income
Interest income	24,805	20,743	70,146	61,252
Intersegment interest allocations	284	314	786	863
Total interest expense	1,634	826	3,679	2,344
Net interest income	23,455	20,231	67,253	59,771
Provision for loan losses	107	237	372	949
Net interest income after provision	23,348	19,994	66,881	58,822
Noninterest income	2,101	2,160	6,153	8,069
Noninterest expense	13,149	12,382	40,152	38,036
Intersegment expense allocations	130	234	392	623
Income before income taxes	12,430	10,006	33,274	29,478
Income tax expense	4,660	3,712	12,472	10,962
Net income	7,770	6,294	20,802	18,516
Total assets	2,776,262	2,464,438	2,776,262	2,464,438
Loans, net of deferred fees	1,517,186	1,402,330	1,517,186	1,402,330
Goodwill	32,620	32,620	32,620	32,620
Factoring
Operating Income
Interest income	3,150	3,131	8,613	9,188
Intersegment interest allocations	(284)	(314)	(786)	(863)
Net interest income	2,866	2,817	7,827	8,325
Provision for loan losses	8	8	18	48
Net interest income after provision	2,858	2,809	7,809	8,277
Noninterest income	359	152	895	517
Noninterest expense	1,685	1,914	5,264	5,326
Intersegment expense allocations	(130)	(234)	(392)	(623)
Income before income taxes	1,402	813	3,048	2,845
Income tax expense	589	342	1,280	1,195
Net income	813	471	1,768	1,650
Total assets	67,686	63,524	67,686	63,524
Loans, net of deferred fees	48,764	47,846	48,764	47,846
Goodwill	$ 13,044	$ 13,044	$ 13,044	$ 13,044