Loans Receivable Held for Investment - Aging of Recorded Investment in Past Due Loans by Loan Type (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
Past due receivable
Total Past Due	$ 14	$ 18
Current	384,531	401,011
Gross loans receivable	384,545	401,029
30-59 Days Past Due
Past due receivable
Total Past Due	14	18
Single family
Past due receivable
Total Past Due	14	18
Current	64,272	73,094
Gross loans receivable	64,286	73,112
Single family | 30-59 Days Past Due
Past due receivable
Total Past Due	14	18
Multi-family
Past due receivable
Current	285,239	289,043
Gross loans receivable	285,239	289,043
Commercial real estate
Past due receivable
Current	14,742	14,818
Gross loans receivable	14,742	14,818
Church
Past due receivable
Current	19,269	20,648
Gross loans receivable	19,269	20,648
Construction
Past due receivable
Current	717	3,125
Gross loans receivable	717	3,125
Commercial - other
Past due receivable
Current	268	262
Gross loans receivable	268	262
Consumer
Past due receivable
Current	24	21
Gross loans receivable	$ 24	$ 21