Loans Receivable Held for Investment (Details 6) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2013	Dec. 31, 2012
Investment in non-accrual loans by class of loans
Total non-accrual loans	$ 20,135	$ 37,090
Loans 90 days or more delinquent that were accruing interest	0	0
Loans receivable held for sale | One-to-four units
Investment in non-accrual loans by class of loans
Total non-accrual loans		6,656
Loans receivable held for sale | Five or more units
Investment in non-accrual loans by class of loans
Total non-accrual loans		1,956
Loans receivable held for sale | Church
Investment in non-accrual loans by class of loans
Total non-accrual loans	785	1,556
Loans receivable held for investment | One-to-four units
Investment in non-accrual loans by class of loans
Total non-accrual loans	1,694	1,489
Loans receivable held for investment | Five or more units
Investment in non-accrual loans by class of loans
Total non-accrual loans	3,041	2,312
Loans receivable held for investment | Commercial real estate
Investment in non-accrual loans by class of loans
Total non-accrual loans	1,451	7,090
Loans receivable held for investment | Church
Investment in non-accrual loans by class of loans
Total non-accrual loans	13,002	15,689
Loans receivable held for investment | Construction
Investment in non-accrual loans by class of loans
Total non-accrual loans		273
Loans receivable held for investment | Commercial Other
Investment in non-accrual loans by class of loans
Total non-accrual loans	$ 162	$ 69