Note 6 - Goodwill and Intangibles - Goodwill by Reportable Segment (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017	Dec. 31, 2016
Segment Reporting Information [Line Items]
Goodwill	$ 74,748	$ 77,832	$ 28,334	$ 13,111
SFC Bank
Segment Reporting Information [Line Items]
Goodwill	45,975	45,975
Other Segments
Segment Reporting Information [Line Items]
Goodwill	682	3,766
Commercial Banking | QCBT
Segment Reporting Information [Line Items]
Goodwill	3,223	3,223	3,223
Commercial Banking | CRBT
Segment Reporting Information [Line Items]
Goodwill	14,980	14,980	15,223
Commercial Banking | CSB
Segment Reporting Information [Line Items]
Goodwill	9,888	9,888	$ 9,888
Commercial Banking | SFC Bank
Segment Reporting Information [Line Items]
Goodwill	$ 45,975	$ 45,975