Note 17 - Segment Information - Schedule of Segment Reporting Information (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2019	Sep. 30, 2018	Sep. 30, 2019	Sep. 30, 2018	Dec. 31, 2018
Net Interest Income	$ 12,648	$ 10,105	$ 34,830	$ 30,399
Provision for Loan Losses	214	61	524	131
Total Noninterest Income	4,039	2,405	10,373	7,163
Noninterest Expenses	13,358	9,078	35,397	26,215
Income Taxes	597	676	1,827	2,264
Segment Profit (Loss)	2,518	2,695	7,455	8,952
Segment Assets	1,477,682	1,186,196	1,477,682	1,186,196	$ 1,251,878
Bank [Member]
Net Interest Income	13,018	10,359	35,850	31,112
Provision for Loan Losses	214	61	524	131
Total Noninterest Income	2,737	2,397	8,412	7,142
Noninterest Expenses	11,252	8,766	31,461	25,416
Income Taxes	893	792	2,448	2,574
Segment Profit (Loss)	3,396	3,137	9,829	10,133
Segment Assets	1,461,210	1,184,284	1,461,210	1,184,284
Mortgage Loan Banking [Member]
Net Interest Income	81		100
Provision for Loan Losses
Total Noninterest Income	1,245		1,888
Noninterest Expenses	1,191		2,037
Income Taxes	(15)		(10)
Segment Profit (Loss)	150		(39)
Segment Assets	10,209		10,209
Small Business Specialty Lending Division [Member]
Net Interest Income
Provision for Loan Losses
Total Noninterest Income
Noninterest Expenses	529		561
Income Taxes	(111)		(118)
Segment Profit (Loss)	(418)		(443)
Segment Assets	149		149
Corporate Segment [Member]
Net Interest Income	(451)	(254)	(1,120)	(713)
Provision for Loan Losses
Total Noninterest Income	57	8	73	21
Noninterest Expenses	386	312	1,338	799
Income Taxes	(170)	(116)	(493)	(310)
Segment Profit (Loss)	(610)	(442)	(1,892)	(1,181)
Segment Assets	$ 6,114	$ 1,912	$ 6,114	$ 1,912