Note 12 - Income Taxes - Deferred Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Dec. 31, 2023	Dec. 31, 2022
Loan loss allowance	$ 50,126	$ 47,673
Accrual for bonuses	4,636	2,591
Non-accrual interest	2,164	1,572
Write-down on equity securities and venture capital investments	2,018	1,975
Depreciation and amortization	765	0
State tax	5,693	6,251
Unrealized loss on securities available-for-sale, net	31,728	40,400
Tax credits carried forward	9,136	9,136
Net operating loss carried forward	3,787	5,916
Other, net	7,632	4,711
Gross deferred tax assets	117,685	120,225
Deferred loan costs	(9,687)	(10,025)
Depreciation and amortization	0	(2,856)
Unrealized gain on interest rate swaps	(838)	(1,364)
Unrealized gain on equity securities	(4,863)	0
Dividends on Federal Home Loan Bank common stock	(977)	(981)
Other, net	(3,916)	(3,506)
Gross deferred tax liabilities	(20,281)	(18,732)
Net deferred tax assets	$ 97,404	$ 101,493