Loans Receivable Held for Investment - Aging of Recorded Investment in Past Due Loans by Loan Type (Details) - USD ($) $ in Thousands	Mar. 31, 2017	Dec. 31, 2016
Past due receivable
Total Past Due	$ 1,795	$ 1,388
Current	364,335	382,669
30-59 Days Past Due
Past due receivable
Total Past Due	412	1,324
60-89 Days Past Due
Past due receivable
Total Past Due	1,383	64
Single family
Past due receivable
Total Past Due	60	64
Current	99,119	105,268
Single family | 60-89 Days Past Due
Past due receivable
Total Past Due	60	64
Multi-family
Past due receivable
Current	222,378	231,440
Commercial real estate
Past due receivable
Total Past Due	1,323	1,324
Current	6,449	7,597
Commercial real estate | 30-59 Days Past Due
Past due receivable
Total Past Due		1,324
Commercial real estate | 60-89 Days Past Due
Past due receivable
Total Past Due	1,323
Church
Past due receivable
Total Past Due	412
Current	35,212	37,223
Church | 30-59 Days Past Due
Past due receivable
Total Past Due	412
Construction
Past due receivable
Current	855	827
Commercial - other
Past due receivable
Current	307	308
Consumer
Past due receivable
Current	$ 15	$ 6