Loans Receivable Held for Investment (Details 3) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Mar. 31, 2014	Dec. 31, 2013	Jun. 30, 2013	Mar. 31, 2013	Dec. 31, 2012
Ending allowance balance attributable to loans:
Individually evaluated for impairment	$ 1,797		$ 2,187
Collectively evaluated for impairment	7,579		7,959
Total ending allowance balance	9,376	10,091	10,146	10,579	10,450	11,869
Loans:
Loans individually evaluated for impairment	28,117		33,503
Loans collectively evaluated for impairment	244,661		223,334
Total ending loans balance	272,778		256,837
One-to-four units
Ending allowance balance attributable to loans:
Individually evaluated for impairment	377		382
Collectively evaluated for impairment	1,472		1,548
Total ending allowance balance	1,849	1,874	1,930	2,445	1,834	2,060
Loans:
Loans individually evaluated for impairment	2,978		3,053
Loans collectively evaluated for impairment	41,862		43,406
Total ending loans balance	44,840		46,459
Five or more units
Ending allowance balance attributable to loans:
Individually evaluated for impairment	131		143
Collectively evaluated for impairment	2,173		1,583
Total ending allowance balance	2,304	2,107	1,726	1,169	1,123	2,122
Loans:
Loans individually evaluated for impairment	3,521		4,163
Loans collectively evaluated for impairment	141,570		109,055
Total ending loans balance	145,091		113,218
Commercial real estate
Ending allowance balance attributable to loans:
Individually evaluated for impairment	195		206
Collectively evaluated for impairment	886		1,267
Total ending allowance balance	1,081	1,212	1,473	1,674	1,549	2,685
Loans:
Loans individually evaluated for impairment	4,740		4,894
Loans collectively evaluated for impairment	18,698		21,803
Total ending loans balance	23,438		26,697
Church
Ending allowance balance attributable to loans:
Individually evaluated for impairment	1,083		1,444
Collectively evaluated for impairment	3,029		3,505
Total ending allowance balance	4,112	4,867	4,949	5,060	5,677	4,818
Loans:
Loans individually evaluated for impairment	16,756		21,243
Loans collectively evaluated for impairment	41,630		46,691
Total ending loans balance	58,386		67,934
Construction
Ending allowance balance attributable to loans:
Collectively evaluated for impairment	7		7
Total ending allowance balance	7	7	7	8	8	8
Loans:
Loans collectively evaluated for impairment	407		424
Total ending loans balance	407		424
Commercial - other
Ending allowance balance attributable to loans:
Individually evaluated for impairment	11		12
Collectively evaluated for impairment	8		43
Total ending allowance balance	19	20	55	213	250	167
Loans:
Loans individually evaluated for impairment	122		150
Loans collectively evaluated for impairment	473		1,917
Total ending loans balance	595		2,067
Consumer
Ending allowance balance attributable to loans:
Collectively evaluated for impairment	4		6
Total ending allowance balance	4	4	6	10	9	9
Loans:
Loans collectively evaluated for impairment	21		38
Total ending loans balance	$ 21		$ 38