Loans Receivable Held for Investment - Summary (Details) - USD ($)	Mar. 31, 2017	Dec. 31, 2016	Mar. 31, 2016	Dec. 31, 2015
Loans Receivable Held for Investment
Gross loans receivable before deferred loan costs and premiums	$ 364,335,000	$ 382,264,000
Unamortized net deferred loan costs and premiums	1,795,000	1,793,000
Total ending loans balance	366,130,000	384,057,000
Allowance for loan losses	(4,392,000)	(4,603,000)	$ (4,534,000)	$ (4,828,000)
Loans receivable, net	361,738,000	379,454,000
Single family
Loans Receivable Held for Investment
Gross loans receivable before deferred loan costs and premiums	98,676,000	104,807,000
Total ending loans balance	99,179,000	105,332,000
Allowance for loan losses	(330,000)	(367,000)	(528,000)	(597,000)
Non-impaired purchased loans	78,500,000	81,900,000
Allowance for non-impaired purchased loans	0	0
Multi-family
Loans Receivable Held for Investment
Gross loans receivable before deferred loan costs and premiums	220,556,000	229,566,000
Total ending loans balance	222,378,000	231,440,000
Allowance for loan losses	(2,711,000)	(2,659,000)	(1,866,000)	(1,658,000)
Commercial real estate
Loans Receivable Held for Investment
Gross loans receivable before deferred loan costs and premiums	7,766,000	8,914,000
Total ending loans balance	7,772,000	8,921,000
Allowance for loan losses	(75,000)	(215,000)	(444,000)	(469,000)
Church
Loans Receivable Held for Investment
Gross loans receivable before deferred loan costs and premiums	36,153,000	37,826,000
Total ending loans balance	35,624,000	37,223,000
Allowance for loan losses	(1,250,000)	(1,337,000)	(1,676,000)	(2,083,000)
Construction
Loans Receivable Held for Investment
Gross loans receivable before deferred loan costs and premiums	862,000	837,000
Total ending loans balance	855,000	827,000
Allowance for loan losses	(9,000)	(8,000)	(3,000)	(3,000)
Commercial - other
Loans Receivable Held for Investment
Gross loans receivable before deferred loan costs and premiums	307,000	308,000
Total ending loans balance	307,000	308,000
Allowance for loan losses	(16,000)	(17,000)	$ (17,000)	$ (18,000)
Consumer
Loans Receivable Held for Investment
Gross loans receivable before deferred loan costs and premiums	15,000	6,000
Total ending loans balance	15,000	$ 6,000
Allowance for loan losses	$ (1,000)