Note 10 - Income Taxes - Deferred Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Dec. 31, 2021	Dec. 31, 2020
Loan loss allowance, due to differences in computation of bad debts	$ 43,895	$ 52,899
Share-based compensation	0	1,936
Accrual for bonuses	4,935	3,356
Non-accrual interest	1,117	861
Write-down on equity securities and venture capital investments	2,000	1,833
State tax	4,691	3,882
Unrealized loss on interest rate swaps	1,394	2,934
Tax credits carried forward	9,136	9,136
Net operating loss carried forward	8,732	10,880
Other, net	3,765	3,864
Gross deferred tax assets	79,665	91,581
Deferred loan costs	(9,936)	(10,017)
Depreciation and amortization	(3,150)	(2,709)
Unrealized gain on securities	(3,823)	(8,712)
OREO Installment Sale	(1,273)	(1,274)
Dividends on Federal Home Loan Bank common stock	(978)	(979)
Other, net	(2,168)	(3,599)
Gross deferred tax liabilities	(21,328)	(27,290)
Net deferred tax assets	$ 58,337	$ 64,291