Loans Receivable Held for Investment (Details 2) (USD $) In Thousands, unless otherwise specified	3 Months Ended		9 Months Ended		3 Months Ended		9 Months Ended		3 Months Ended		9 Months Ended		3 Months Ended		9 Months Ended		3 Months Ended		9 Months Ended		3 Months Ended	9 Months Ended				3 Months Ended		9 Months Ended		3 Months Ended		9 Months Ended
	Sep. 30, 2014	Sep. 30, 2013	Sep. 30, 2014	Sep. 30, 2013	Sep. 30, 2014 Single family	Sep. 30, 2013 Single family	Sep. 30, 2014 Single family	Sep. 30, 2013 Single family	Sep. 30, 2014 Multi-family	Sep. 30, 2013 Multi-family	Sep. 30, 2014 Multi-family	Sep. 30, 2013 Multi-family	Sep. 30, 2014 Commercial real estate	Sep. 30, 2013 Commercial real estate	Sep. 30, 2014 Commercial real estate	Sep. 30, 2013 Commercial real estate	Sep. 30, 2014 Church	Sep. 30, 2013 Church	Sep. 30, 2014 Church	Sep. 30, 2013 Church	Sep. 30, 2013 Construction	Sep. 30, 2013 Construction	Sep. 30, 2014 Construction	Jun. 30, 2014 Construction	Dec. 31, 2013 Construction	Sep. 30, 2014 Commercial - other	Sep. 30, 2013 Commercial - other	Sep. 30, 2014 Commercial - other	Sep. 30, 2013 Commercial - other	Sep. 30, 2014 Consumer	Sep. 30, 2013 Consumer	Sep. 30, 2014 Consumer	Sep. 30, 2013 Consumer
Allowance for loan losses
Beginning balance	$ 9,376	$ 10,579	$ 10,146	$ 11,869	$ 1,849	$ 2,445	$ 1,930	$ 2,060	$ 2,304	$ 1,169	$ 1,726	$ 2,122	$ 1,081	$ 1,674	$ 1,473	$ 2,685	$ 4,112	$ 5,060	$ 4,949	$ 4,818	$ 8	$ 8	$ 7	$ 7	$ 7	$ 19	$ 213	$ 55	$ 167	$ 4	$ 10	$ 6	$ 9
Provision for (recapture of) loan losses	(950)	414	(2,532)	414	(465)	(315)	(455)	(150)	327	351	905	56	(96)	72	(479)	(96)	(724)	523	(1,408)	929	(1)	(1)				10	(213)	(1,091)	(322)	(2)	(3)	(4)	(2)
Recoveries	682	80	1,936	608			2	259						16		117	682	5	851	18							59	1,083	214
Loans charged off	(41)	(734)	(483)	(2,552)	(40)	(51)	(133)	(90)		(3)		(661)		(190)	(9)	(1,134)	(1)	(490)	(323)	(667)								(18)
Ending balance	$ 9,067	$ 10,339	$ 9,067	$ 10,339	$ 1,344	$ 2,079	$ 1,344	$ 2,079	$ 2,631	$ 1,517	$ 2,631	$ 1,517	$ 985	$ 1,572	$ 985	$ 1,572	$ 4,069	$ 5,098	$ 4,069	$ 5,098	$ 7	$ 7	$ 7	$ 7	$ 7	$ 29	$ 59	$ 29	$ 59	$ 2	$ 7	$ 2	$ 7