Loans Receivable Held for Investment (Details 4) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2013	Dec. 31, 2012
Impaired loans
Unpaid principal balance	$ 45,217	$ 55,765
Recorded investment	35,467	44,376
Allowance for loan losses allocated, with an allowance recorded	2,632	2,732
One-to-four units
Impaired loans
Unpaid principal balance, with no related allowance recorded	1,784	1,986
Unpaid principal balance, with an allowance recorded	2,506	3,092
Recorded investment, with no related allowance recorded	1,211	1,484
Recorded investment, with an allowance recorded	2,502	3,092
Allowance for loan losses allocated, with an allowance recorded	636	719
Five or more units
Impaired loans
Unpaid principal balance, with no related allowance recorded	1,835	2,038
Unpaid principal balance, with an allowance recorded	1,105	1,947
Recorded investment, with no related allowance recorded	1,806	1,819
Recorded investment, with an allowance recorded	1,105	1,947
Allowance for loan losses allocated, with an allowance recorded	60	125
Commercial real estate
Impaired loans
Unpaid principal balance, with no related allowance recorded	3,623	10,184
Unpaid principal balance, with an allowance recorded	6,163	3,941
Recorded investment, with no related allowance recorded	403	6,423
Recorded investment, with an allowance recorded	6,163	3,941
Allowance for loan losses allocated, with an allowance recorded	182	543
Church
Impaired loans
Unpaid principal balance, with no related allowance recorded	11,227	18,664
Unpaid principal balance, with an allowance recorded	12,958	9,677
Recorded investment, with no related allowance recorded	9,190	15,689
Recorded investment, with an allowance recorded	12,921	9,639
Allowance for loan losses allocated, with an allowance recorded	1,588	1,276
Construction
Impaired loans
Unpaid principal balance, with no related allowance recorded		279
Recorded investment, with no related allowance recorded		273
Commercial Sports
Impaired loans
Unpaid principal balance, with no related allowance recorded	3,850	3,888
Commercial Other
Impaired loans
Unpaid principal balance, with an allowance recorded	97
Recorded investment, with an allowance recorded	97
Allowance for loan losses allocated, with an allowance recorded	97
Consumer Other
Impaired loans
Unpaid principal balance, with an allowance recorded	69	69
Recorded investment, with an allowance recorded	69	69
Allowance for loan losses allocated, with an allowance recorded	$ 69	$ 69