Loans Receivable Held for Investment (Details 2) (USD $) In Thousands, unless otherwise specified	3 Months Ended		9 Months Ended
	Sep. 30, 2013	Sep. 30, 2012	Sep. 30, 2013	Sep. 30, 2012
Allowance for loan losses
Beginning balance	$ 10,579	$ 17,856	$ 11,869	$ 17,299
Provision for loan losses	414	129	414	1,190
Recoveries	80	119	608	415
Loans charged off	(734)	(1,120)	(2,552)	(1,920)
Ending balance	10,339	16,984	10,339	16,984
One-to-four units
Allowance for loan losses
Beginning balance	2,445	4,701	2,060	4,855
Provision for loan losses	(315)	453	(150)	654
Recoveries			259
Loans charged off	(51)	(539)	(90)	(894)
Ending balance	2,079	4,615	2,079	4,615
Five or more units
Allowance for loan losses
Beginning balance	1,169	2,897	2,122	2,972
Provision for loan losses	351	(326)	56	(401)
Recoveries		1		1
Loans charged off	(3)	(14)	(661)	(14)
Ending balance	1,517	2,558	1,517	2,558
Commercial real estate
Allowance for loan losses
Beginning balance	1,674	2,640	2,685	3,108
Provision for loan losses	72	135	(96)	(305)
Recoveries	16	15	117	45
Loans charged off	(190)	(346)	(1,134)	(404)
Ending balance	1,572	2,444	1,572	2,444
Church
Allowance for loan losses
Beginning balance	5,060	7,223	4,818	5,742
Provision for loan losses	523	3	929	1,864
Recoveries	5	3	18	10
Loans charged off	(490)	(221)	(667)	(608)
Ending balance	5,098	7,008	5,098	7,008
Construction
Allowance for loan losses
Beginning balance	8	106	8	249
Provision for loan losses	(1)	(1)	(1)	(144)
Ending balance	7	105	7	105
Commercial
Allowance for loan losses
Beginning balance	213	270	167	316
Provision for loan losses	(213)	(126)	(322)	(427)
Recoveries	59	97	214	352
Ending balance	59	241	59	241
Consumer
Allowance for loan losses
Beginning balance	10	19	9	57
Provision for loan losses	(3)	(9)	(2)	(51)
Recoveries		3		7
Ending balance	$ 7	$ 13	$ 7	$ 13