Other Assets (Details) - USD ($) $ in Thousands		Dec. 31, 2022	Dec. 31, 2021	Dec. 31, 2020
Deferred Costs, Capitalized, Prepaid, and Other Assets Disclosure [Abstract]
Receivable for sale of unsettled residential whole loans		$ 275,656	$ 0
REO		130,605	156,223	$ 249,699
Goodwill		61,076	61,076
Intangible assets, net		12,200	21,400
Capital contributions made to loan origination partners		28,308	71,673
Other interest-earning assets		63,964	57,522
Interest receivable		68,704	50,191
Other loan related receivables		$ 23,463	$ 34,191
Operating Lease, Right-of-Use Asset, Statement of Financial Position [Extensible Enumeration]		Total Other Assets	Total Other Assets
Lease right-of-use asset		$ 39,459	$ 39,370
Other		62,786	73,910
Total Other Assets	[1]	766,221	565,556
Real estate held-for-investment			11,300
Accumulated amortization		$ 15,800	$ 6,600
Borrowing rate		7.50%

[1] See Note 6 for information regarding the Company’s pledged assets.