Loans Receivable Held for Investment (Details 6) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Investment in non-accrual loans by class of loans
Total non-accrual loans	$ 17,702	$ 37,090
Loans 90 days or more delinquent that were accruing interest	0	0
Loans receivable held for sale | One-to-four units
Investment in non-accrual loans by class of loans
Total non-accrual loans		6,656
Loans receivable held for sale | Five or more units
Investment in non-accrual loans by class of loans
Total non-accrual loans		1,956
Loans receivable held for sale | Church
Investment in non-accrual loans by class of loans
Total non-accrual loans		1,556
Loans receivable held for investment | One-to-four units
Investment in non-accrual loans by class of loans
Total non-accrual loans	1,441	1,489
Loans receivable held for investment | Five or more units
Investment in non-accrual loans by class of loans
Total non-accrual loans	2,985	2,312
Loans receivable held for investment | Commercial real estate
Investment in non-accrual loans by class of loans
Total non-accrual loans	1,391	7,090
Loans receivable held for investment | Church
Investment in non-accrual loans by class of loans
Total non-accrual loans	11,735	15,689
Loans receivable held for investment | Construction
Investment in non-accrual loans by class of loans
Total non-accrual loans		273
Loans receivable held for investment | Commercial Other
Investment in non-accrual loans by class of loans
Total non-accrual loans	$ 150	$ 69