Loans Held-for-Investment, Net of Allowance for Credit Losses - by Geographic Location (Details) - USD ($) $ in Thousands	Jun. 30, 2023	Mar. 31, 2023	Dec. 31, 2022	Jun. 30, 2022	Mar. 31, 2022	Dec. 31, 2021
Accounts, Notes, Loans and Financing Receivable [Line Items]
Carrying Value	$ 2,966,088	$ 3,182,379	$ 3,267,815	$ 3,830,014	$ 3,750,470	$ 3,741,308
Percentage of loan portfolio (as a percent)	100.00%		100.00%
Northeast
Accounts, Notes, Loans and Financing Receivable [Line Items]
Carrying Value	$ 727,567		$ 834,985
Percentage of loan portfolio (as a percent)	24.50%		25.50%
Southwest
Accounts, Notes, Loans and Financing Receivable [Line Items]
Carrying Value	$ 652,422		$ 675,288
Percentage of loan portfolio (as a percent)	22.00%		20.70%
West
Accounts, Notes, Loans and Financing Receivable [Line Items]
Carrying Value	$ 434,858		$ 519,244
Percentage of loan portfolio (as a percent)	14.70%		15.90%
Midwest
Accounts, Notes, Loans and Financing Receivable [Line Items]
Carrying Value	$ 480,478		$ 546,030
Percentage of loan portfolio (as a percent)	16.20%		16.70%
Southeast
Accounts, Notes, Loans and Financing Receivable [Line Items]
Carrying Value	$ 670,763		$ 692,268
Percentage of loan portfolio (as a percent)	22.60%		21.20%