Note 3 - Loans and Allowance for Loan Losses - Non-performing Loans (Details) - USD ($) $ in Thousands	Dec. 31, 2016	Dec. 31, 2015
Loans ninety days or more past due and still accruing:
Loans ninety days or more past due and still accruing	$ 386	$ 3,260
Non-accrual loans	21,030	22,817
Total non-performing loans	21,416	26,077
Mortgage Receivable [Member]
Loans ninety days or more past due and still accruing:
Non-accrual loans	15,251	22,031
Non-Mortgage Loans [Member]
Loans ninety days or more past due and still accruing:
Non-accrual loans	5,779	786
Multi-family Residential Portfolio Segment [Member]
Loans ninety days or more past due and still accruing:
Loans ninety days or more past due and still accruing	0	233
Multi-family Residential Portfolio Segment [Member] | Mortgage Receivable [Member]
Loans ninety days or more past due and still accruing:
Non-accrual loans	1,837	3,561
Commercial Real Estate Portfolio Segment [Member]
Loans ninety days or more past due and still accruing:
Loans ninety days or more past due and still accruing	0	1,183
Commercial Real Estate Portfolio Segment [Member] | Mortgage Receivable [Member]
Loans ninety days or more past due and still accruing:
Non-accrual loans	1,148	2,398
One-To-Four Family - Mixed-Use Property Portfolio Segment [Member]
Loans ninety days or more past due and still accruing:
Loans ninety days or more past due and still accruing	386	611
One-To-Four Family - Mixed-Use Property Portfolio Segment [Member] | Mortgage Receivable [Member]
Loans ninety days or more past due and still accruing:
Non-accrual loans	4,025	5,952
One-To-Four Family - Residential Portfolio Segment [Member]
Loans ninety days or more past due and still accruing:
Loans ninety days or more past due and still accruing	0	13
One-To-Four Family - Residential Portfolio Segment [Member] | Mortgage Receivable [Member]
Loans ninety days or more past due and still accruing:
Non-accrual loans	8,241	10,120
Construction Portfolio Segment [Member]
Loans ninety days or more past due and still accruing:
Loans ninety days or more past due and still accruing	0	1,000
Commercial Business and Other Portfolio Segment [Member]
Loans ninety days or more past due and still accruing:
Loans ninety days or more past due and still accruing	0	220
Commercial Business and Other Portfolio Segment [Member] | Non-Mortgage Loans [Member]
Loans ninety days or more past due and still accruing:
Non-accrual loans	68	568
Small Business Administration Portfolio Segment [Member] | Non-Mortgage Loans [Member]
Loans ninety days or more past due and still accruing:
Non-accrual loans	1,886	218
Taxi Medallion Portfolio Segment [Member] | Non-Mortgage Loans [Member]
Loans ninety days or more past due and still accruing:
Non-accrual loans	$ 3,825	$ 0