Fair Value Measurements - Changes in the Fair Value of Securities Classified as Level 3 (Details) - USD ($) $ in Thousands	3 Months Ended	6 Months Ended	12 Months Ended
	Jun. 30, 2022	Jun. 30, 2022	Dec. 31, 2021
Securitized Debt | Variable Interest Entities, Primary Beneficiary | Level 3
Fair Value, Liabilities Measured on Recurring Basis [Roll Forward]
Securitized Debt, Beginning balance, Level 3		$ 7,726,043	$ 8,711,677
Securitized Debt, Transfers in to Level 3 assets		0	0
Securitized Debt, Transfers out of Level 3 assets		0	0
Securitized Debt, Transfer due to consolidation		774,514
Securitized Debt, Purchases of assets/ issuance of debt		755,203	5,521,953
Securitized Debt, Principal payments		(1,054,198)	(2,247,983)
Securitized Debt, Sales and Settlements		0	(4,192,295)
Securitized Debt, Net accretion (amortization)		1,337	12,010
Securitized Debt, Other than temporary credit impairment losses		0	0
Securitized Debt, Realized gains (losses) on sales and settlements		0	258,903
Securitized Debt, Net unrealized gains (losses) included in income		(520,608)	(338,222)
Securitized Debt, Gains (losses) included in other comprehensive income		0	0
Securitized Debt, Ending balance, Level 3	$ 7,682,291	7,682,291	7,726,043
Non-Agency RMBS | Level 3
Fair Value, Assets Measured on Recurring Basis [Roll Forward]
Beginning balance Level 3		1,810,208	2,150,714
Transfers into Level 3		0	0
Transfers out of Level 3		0	0
Transfer due to consolidation		(218,276)
Purchases of assets/ issuance of debt		23,000	34,656
Principal payments		(126,185)	(299,330)
Sales and settlements		0	(47,674)
Net accretion (amortization)		17,039	57,473
Gains (losses) included in net income
(Increase) decrease in provision for credit losses		(4,737)	(33)
Realized gains (losses) on sales and settlements		0	32,807
Net unrealized gains (losses) included in income		(82,258)	31,358
Gains (losses) included in other comprehensive income
Total unrealized gains (losses) for the period		(97,016)	(149,763)
Ending balance Level 3	1,321,775	1,321,775	1,810,208
Loans held for investment
Fair Value, Assets Measured on Recurring Basis [Roll Forward]
Transfers out of Level 3	0	0	(272,000)
Loans held for investment | Variable Interest Entities, Primary Beneficiary
Fair Value, Assets Measured on Recurring Basis [Roll Forward]
Sales and settlements		(1,890)	(1,679,280)
Gains (losses) included in net income
Net unrealized gains (losses) included in income		(1,048,948)	196,603
Loans held for investment | Variable Interest Entities, Primary Beneficiary | Level 3
Fair Value, Assets Measured on Recurring Basis [Roll Forward]
Beginning balance Level 3		12,032,299	13,112,129
Transfers into Level 3		0	0
Transfers out of Level 3		0	(272,198)
Transfer due to consolidation		1,047,838
Purchases of assets/ issuance of debt		805,785	3,248,683
Principal payments		(1,119,641)	(2,495,015)
Sales and settlements		(1,890)	(1,679,280)
Net accretion (amortization)		(41,871)	(79,223)
Gains (losses) included in net income
(Increase) decrease in provision for credit losses		0	0
Realized gains (losses) on sales and settlements		0	0
Net unrealized gains (losses) included in income		(1,045,540)	197,203
Gains (losses) included in other comprehensive income
Total unrealized gains (losses) for the period		0	0
Ending balance Level 3	$ 11,676,980	$ 11,676,980	$ 12,032,299