Loans Receivable Held for Investment (Details 2) (USD $) In Thousands, unless otherwise specified	3 Months Ended		6 Months Ended		3 Months Ended		6 Months Ended		3 Months Ended		6 Months Ended		3 Months Ended		6 Months Ended		3 Months Ended		6 Months Ended								3 Months Ended		6 Months Ended		3 Months Ended	6 Months Ended
	Jun. 30, 2014	Jun. 30, 2013	Jun. 30, 2014	Jun. 30, 2013	Jun. 30, 2014 One-to-four units	Jun. 30, 2013 One-to-four units	Jun. 30, 2014 One-to-four units	Jun. 30, 2013 One-to-four units	Jun. 30, 2014 Five or more units	Jun. 30, 2013 Five or more units	Jun. 30, 2014 Five or more units	Jun. 30, 2013 Five or more units	Jun. 30, 2014 Commercial real estate	Jun. 30, 2013 Commercial real estate	Jun. 30, 2014 Commercial real estate	Jun. 30, 2013 Commercial real estate	Jun. 30, 2014 Church	Jun. 30, 2013 Church	Jun. 30, 2014 Church	Jun. 30, 2013 Church	Jun. 30, 2014 Construction	Mar. 31, 2014 Construction	Dec. 31, 2013 Construction	Jun. 30, 2013 Construction	Mar. 31, 2013 Construction	Dec. 31, 2012 Construction	Jun. 30, 2014 Commercial - other	Jun. 30, 2013 Commercial - other	Jun. 30, 2014 Commercial - other	Jun. 30, 2013 Commercial - other	Jun. 30, 2013 Consumer	Jun. 30, 2014 Consumer	Jun. 30, 2013 Consumer	Mar. 31, 2014 Consumer
Allowance for loan losses
Beginning balance	$ 10,091	$ 10,450	$ 10,146	$ 11,869	$ 1,874	$ 1,834	$ 1,930	$ 2,060	$ 2,107	$ 1,123	$ 1,726	$ 2,122	$ 1,212	$ 1,549	$ 1,473	$ 2,685	$ 4,867	$ 5,677	$ 4,949	$ 4,818	$ 7	$ 7	$ 7	$ 8	$ 8	$ 8	$ 20	$ 250	$ 55	$ 167	$ 9	$ 6	$ 9	$ 4
Provision for (recapture of) loan losses	(500)		(1,582)		65	614	10	165	197	66	578	(295)	(131)	39	(383)	(168)	(629)	(623)	(684)	406							(2)	(97)	(1,101)	(109)	1	(2)	1
Recoveries	14	152	1,254	528			2	259						86		101	13	6	169	13							1	60	1,083	155
Loans charged off	(229)	(23)	(442)	(1,818)	(90)	(3)	(93)	(39)		(20)		(658)			(9)	(944)	(139)		(322)	(177)									(18)
Ending balance	$ 9,376	$ 10,579	$ 9,376	$ 10,579	$ 1,849	$ 2,445	$ 1,849	$ 2,445	$ 2,304	$ 1,169	$ 2,304	$ 1,169	$ 1,081	$ 1,674	$ 1,081	$ 1,674	$ 4,112	$ 5,060	$ 4,112	$ 5,060	$ 7	$ 7	$ 7	$ 8	$ 8	$ 8	$ 19	$ 213	$ 19	$ 213	$ 10	$ 4	$ 10	$ 4