Note 11 - Income Taxes - Deferred Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Dec. 31, 2016	Dec. 31, 2015
Deferred Tax Assets
Loan loss allowance, due to differences in computation of bad debts	$ 51,192	$ 59,639
Share-based compensation	4,729	7,513
Accrual for bonuses	6,095	4,984
Non-accrual interest	4,246	4,929
Accrual for litigation		3,209
Write-down on equity securities and venture capital investments	4,437	3,981
Depreciation and amortization	8,334	2,917
State tax	6,426	4,802
Unrealized loss on interest rate swaps	1,763	2,173
Unrealized loss on securities available-for-sale, net	1,121	3,940
Other, net	3,598	2,127
Gross deferred tax assets	91,941	100,214
Deferred Tax Liabilities
Deferred loan costs	(8,695)
Investment in affordable housing partnerships	(2,659)	(1,444)
Basis difference in acquired assets	(4,841)	(4,947)
Dividends on Federal Home Loan Bank common stock	(1,322)	(1,322)
Other, net	(3,228)	(1,937)
Gross deferred tax liabilities	(20,745)	(9,650)
Net deferred tax assets	$ 71,196	$ 90,564