Note 23 - Business Segment Information - Selected Financial Information on the Company's Business Segments (Details) - USD ($) $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2020	Sep. 30, 2020	Jun. 30, 2020	Mar. 31, 2020	Dec. 31, 2019	Sep. 30, 2019	Jun. 30, 2019	Mar. 31, 2019	Dec. 31, 2020	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Total revenue									$ 312,171	$ 294,844	$ 224,420
Net interest income	$ 43,707	$ 44,581	$ 40,956	$ 37,706	$ 39,919	$ 40,719	$ 38,013	$ 36,908	166,950	155,559	142,395
Provision for loan/lease losses	7,080	20,342	19,915	8,367	979	2,012	1,941	2,134	55,704	7,066	12,658
Net income (loss)	18,271	$ 17,344	$ 13,739	$ 11,228	15,891	$ 15,095	$ 13,504	$ 12,918	60,582	57,408	43,120
Goodwill	74,066				74,748				74,066	74,748	77,832	$ 28,334
Intangibles	11,381				14,970				11,381	14,970	17,450
Total assets	5,682,797				4,909,050				5,682,797	4,909,050	4,949,710
Intersegment Eliminations [Member]
Total revenue									(262)	(1,606)	(871)
Net interest income									1,031
Total assets	(324,971)				(65,305)				(324,971)	(65,305)	(26,387)
Commercial Banking | QCBT
Goodwill	3,223				3,223				3,223	3,223	3,223
Commercial Banking | QCBT | Operating Segments [Member]
Total revenue									92,336	87,433	77,129
Net interest income									63,366	52,097	48,682
Provision for loan/lease losses									21,612	3,433	3,693
Net income (loss)									21,557	21,607	20,559
Goodwill	3,223				3,223				3,223	3,223	3,223
Total assets	2,149,469				1,682,477				2,149,469	1,682,477	1,623,369
Commercial Banking | CRBT
Goodwill	14,980				14,980				14,980	14,980	14,980
Commercial Banking | CRBT | Operating Segments [Member]
Total revenue									125,416	96,631	73,208
Net interest income									52,857	44,310	43,038
Provision for loan/lease losses									19,438	1,080	1,833
Net income (loss)									33,890	27,716	20,680
Goodwill	14,980				14,980				14,980	14,980	14,980
Intangibles	2,189				2,684				2,189	2,684	3,186
Total assets	1,952,308				1,572,324				1,952,308	1,572,324	1,379,222
Commercial Banking | CSB
Goodwill	9,888				9,888				9,888	9,888	9,888
Commercial Banking | CSB | Operating Segments [Member]
Total revenue									50,448	42,059	36,649
Net interest income									31,570	31,370	28,763
Provision for loan/lease losses									9,243	679	1,523
Net income (loss)									11,379	10,787	8,449
Goodwill	9,888				9,888				9,888	9,888	9,888
Intangibles	3,305				3,980				3,305	3,980	4,675
Total assets	1,000,670				853,833				1,000,670	853,833	785,364
Commercial Banking | SFCB
Goodwill	45,975				45,975				45,975	45,975	45,975
Commercial Banking | SFCB | Operating Segments [Member]
Total revenue									42,036	31,569	15,153
Net interest income									24,759	21,422	11,835
Provision for loan/lease losses									5,411	1,315	990
Net income (loss)									12,797	8,244	4,816
Goodwill	45,975				45,975				45,975	45,975	45,975
Intangibles	5,887				6,802				5,887	6,802	7,734
Total assets	779,956				748,753				779,956	748,753	632,849
Other Segments | Operating Segments [Member]
Total revenue									2,197	38,758	23,152
Net interest income									(6,633)	6,360	10,077
Provision for loan/lease losses										559	4,619
Net income (loss)									(19,041)	(10,946)	(11,384)
Goodwill					682					682	3,766
Intangibles					1,504					1,504	1,855
Total assets	$ 125,365				$ 116,968				$ 125,365	$ 116,968	$ 555,293