Residential Whole Loans - Fair Value Components of Net Income (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2022	Jun. 30, 2021	Jun. 30, 2022	Jun. 30, 2021
Receivables [Abstract]
Net unrealized (losses)/gains	$ (218,181)	$ 6,226	$ (506,116)	$ 38,313
Other Income	1,767	(205)	1,327	(803)
Total	$ (216,414)	$ 6,021	$ (504,789)	$ 37,510