Use of Special Purpose Entities and Variable Interest Entities - Narrative (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2023	Dec. 31, 2022
Variable Interest Entity [Line Items]
Total residential whole loans	$ 9,000,000	$ 7,500,000
Agency eligible investor loans
Variable Interest Entity [Line Items]
Amount derecognized		598,000
Financing receivable, sale		337,800
Asset-backed Securities, Securitized Loans and Receivables
Variable Interest Entity [Line Items]
Proceeds from issuance of debt	7,089,575	5,286,305
Residential whole loans, carrying value	5,700,000	4,000,000
Securitized debt	4,800,000	3,400,000
Asset-backed Securities, Securitized Loans and Receivables | Other Assets
Variable Interest Entity [Line Items]
Real estate owned at fair value	33,300	36,500
Senior Notes
Variable Interest Entity [Line Items]
Proceeds from issuance of debt	1,800,000	2,300,000
Proceed from debt net of offering expenses and underwriting discount	$ 1,800,000	2,200,000
Securitized debt
Variable Interest Entity [Line Items]
Financing receivable, sale		$ 567,200