Other Assets - Schedule of Other Assets (Details) - USD ($) $ in Thousands		Mar. 31, 2024	Dec. 31, 2023	Mar. 31, 2023	Dec. 31, 2022
Deferred Costs, Capitalized, Prepaid, and Other Assets Disclosure [Abstract]
REO		$ 106,185	$ 110,174	$ 121,215	$ 130,605
Commercial REO		22,194	22,717
Goodwill		61,076	61,076
Intangibles, net		7,200	8,000
Capital contributions made to loan origination partners		19,780	19,780
Commercial loans		45,793	51,426
Interest receivable		104,636	98,924
Other loan related receivables		17,891	24,084
Lease Right-of-Use Asset		37,158	37,819
Other		67,431	63,097
Total Other Assets	[1]	$ 489,344	$ 497,097
Operating Lease, Right-of-Use Asset, Statement of Financial Position [Extensible Enumeration]		Total Other Assets	Total Other Assets
Accumulated amortization		$ 20,800	$ 20,000
Borrowing rate (as a percent)		7.50%

[1] See Note 6 for information regarding the Company’s pledged assets.