Loans Held for Investment and Loans Held for Investment at Fair Value - Summary of Difference Between Aggregate Fair Value and Aggregate Unpaid Principal Balance by Loan Segments (Details) - Nonaccrual Status $ in Thousands	Mar. 31, 2023 USD ($)
Financing Receivable, Past Due [Line Items]
Fair Value	$ 450,732
Unpaid Principal Balance	436,610
Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	446,685
Unpaid Principal Balance	432,696
90+days Past Due or Nonaccrual
Financing Receivable, Past Due [Line Items]
Fair Value	4,047
Unpaid Principal Balance	3,914
Difference	133
Commercial - Purchase
Financing Receivable, Past Due [Line Items]
Fair Value	69,565
Unpaid Principal Balance	66,046
Commercial - Purchase | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	69,565
Unpaid Principal Balance	66,046
Commercial - Refinance
Financing Receivable, Past Due [Line Items]
Fair Value	67,772
Unpaid Principal Balance	63,860
Commercial - Refinance | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	66,651
Unpaid Principal Balance	62,793
Commercial - Refinance | 90+days Past Due or Nonaccrual
Financing Receivable, Past Due [Line Items]
Fair Value	1,121
Unpaid Principal Balance	1,067
Difference	54
Residential 1-4 Unit - Purchase
Financing Receivable, Past Due [Line Items]
Fair Value	110,742
Unpaid Principal Balance	109,625
Residential 1-4 Unit - Purchase | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	110,742
Unpaid Principal Balance	109,625
Residential 1-4 Unit - Refinance
Financing Receivable, Past Due [Line Items]
Fair Value	159,817
Unpaid Principal Balance	154,941
Residential 1-4 Unit - Refinance | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	157,747
Unpaid Principal Balance	152,933
Residential 1-4 Unit - Refinance | 90+days Past Due or Nonaccrual
Financing Receivable, Past Due [Line Items]
Fair Value	2,070
Unpaid Principal Balance	2,008
Difference	62
Short Term 1-4 Unit - Purchase
Financing Receivable, Past Due [Line Items]
Fair Value	19,765
Unpaid Principal Balance	19,473
Short Term 1-4 Unit - Purchase | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	18,909
Unpaid Principal Balance	18,634
Short Term 1-4 Unit - Purchase | 90+days Past Due or Nonaccrual
Financing Receivable, Past Due [Line Items]
Fair Value	856
Unpaid Principal Balance	839
Difference	17
Short Term 1-4 Unit - Refinance
Financing Receivable, Past Due [Line Items]
Fair Value	23,071
Unpaid Principal Balance	22,665
Short Term 1-4 Unit - Refinance | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	23,071
Unpaid Principal Balance	$ 22,665