Note 11 - Income Taxes - Deferred Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Dec. 31, 2017	Dec. 31, 2016
Deferred Tax Assets
Loan loss allowance, due to differences in computation of bad debts	$ 37,157	$ 51,192
Share-based compensation	2,630	4,729
Accrual for bonuses	630	6,095
Non-accrual interest	2,100	4,246
Write-down on equity securities and venture capital investments	2,561	4,437
Depreciation and amortization	1,564	8,334
State tax	6,783	6,426
Unrealized loss on interest rate swaps	1,158	1,763
Unrealized loss on securities available-for-sale, net		1,121
Investment in affordable housing partnerships	580
Basis difference in acquired assets	1,676
Tax credits carried forward	9,278
Net operating loss carried forward	18,375
Other, net	3,279	3,598
Gross deferred tax assets	87,771	91,941
Deferred Tax Liabilities
Deferred loan costs	(7,655)	(8,695)
Investment in affordable housing partnerships		(2,659)
Basis difference in acquired assets		(4,841)
Dividends on Federal Home Loan Bank common stock	(1,021)	(1,322)
Other, net	(3,758)	(3,228)
Gross deferred tax liabilities	(12,434)	(20,745)
Net deferred tax assets	$ 75,337	$ 71,196