Residential Whole Loans - Fair Value Components of Net Income (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2022	Sep. 30, 2021	Sep. 30, 2022	Sep. 30, 2021
Receivables [Abstract]
Net unrealized (losses)/gains	$ (291,818)	$ 20,494	$ (797,934)	$ 58,807
Other Income	(57)	1,321	1,270	518
Total	$ (291,875)	$ 21,815	$ (796,664)	$ 59,325