Note 23 - Business Segment Information - Selected Financial Information on the Company's Business Segments (Details) - USD ($) $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2019	Sep. 30, 2019	Jun. 30, 2019	Mar. 31, 2019	Dec. 31, 2018	Sep. 30, 2018	Jun. 30, 2018	Mar. 31, 2018	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017	Dec. 31, 2016
Total revenue									$ 294,844	$ 224,420	$ 165,999
Net interest income	$ 39,919	$ 40,719	$ 38,013	$ 36,908	$ 39,595	$ 38,314	$ 32,085	$ 32,403	155,559	142,395	116,065
Provision for loan/lease losses	979	2,012	1,941	2,134	1,612	6,206	2,301	2,540	7,066	12,658	8,470
Net income (loss)	15,891	$ 15,095	$ 13,504	$ 12,918	13,316	$ 8,809	$ 10,445	$ 10,550	57,408	43,120	35,707
Goodwill	74,748				77,832				74,748	77,832	28,334	$ 13,111
Intangibles	14,970				17,450				14,970	17,450	9,079
Total assets	4,909,050				4,949,710				4,909,050	4,949,710	3,982,665
Intersegment Eliminations [Member]
Total revenue									(223)	(871)	(500)
Total assets	(65,306)				(26,387)				(65,306)	(26,387)	(26,924)
SFC Bank
Total revenue									31,569	15,152
Net interest income									21,422	11,835
Provision for loan/lease losses									1,315	990
Net income (loss)									8,243	4,816
Goodwill	45,975				45,975				45,975	45,975
Intangibles	6,802				7,735				6,802	7,735
Total assets	748,753				632,849				748,753	632,849
Commercial Banking | QCBT
Goodwill	3,223				3,223				3,223	3,223	3,223
Commercial Banking | QCBT | Operating Segments [Member]
Total revenue									79,418	69,691	58,056
Net interest income									52,097	48,682	46,407
Provision for loan/lease losses									3,433	3,693	3,909
Net income (loss)									19,006	18,347	22,095
Goodwill	3,223				3,223				3,223	3,223	3,223
Total assets	1,682,477				1,623,369				1,682,477	1,623,369	1,541,778
Commercial Banking | CRBT
Goodwill	14,980				14,980				14,980	14,980	15,223
Commercial Banking | CRBT | Operating Segments [Member]
Total revenue									93,147	69,864	45,367
Net interest income									44,310	43,038	31,042
Provision for loan/lease losses									1,080	1,833	1,050
Net income (loss)									26,940	20,044	10,712
Goodwill	14,980				14,980				14,980	14,980	15,223
Intangibles	2,684				3,186				2,684	3,186	3,694
Total assets	1,572,324				1,379,222				1,572,324	1,379,222	1,307,377
Commercial Banking | CSB
Goodwill	9,888				9,888				9,888	9,888	9,888
Commercial Banking | CSB | Operating Segments [Member]
Total revenue									41,589	36,069	31,944
Net interest income									31,370	28,763	27,021
Provision for loan/lease losses									679	1,523	2,783
Net income (loss)									10,824	8,389	7,048
Goodwill	9,888				9,888				9,888	9,888	9,888
Intangibles	3,980				4,675				3,980	4,675	5,385
Total assets	853,834				785,364				853,834	785,364	670,516
Commercial Banking | SFC Bank
Goodwill	45,975				45,975				45,975	45,975
Wealth Management Segment [Member] | Operating Segments [Member]
Total revenue									16,553	13,433	11,058
Net income (loss)									3,567	2,952	2,241
Other Segments | Operating Segments [Member]
Total revenue									32,791	21,082	20,074
Net interest income									6,360	10,077	11,595
Provision for loan/lease losses									559	4,619	728
Net income (loss)									(11,172)	(11,428)	(6,389)
Goodwill	682				3,766				682	3,766
Intangibles	1,504				1,854				1,504	1,854
Total assets	$ 116,968				$ 555,293				$ 116,968	$ 555,293	$ 489,918