Commitments and Contingencies (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2023	Dec. 31, 2023	Dec. 31, 2022
Other Commitments [Line Items]
Operating Leases, Future Minimum Payments Due, Next Twelve Months	$ 710
Operating Leases, Future Minimum Payments, Due in Two Years	844
Operating Leases, Future Minimum Payments, Due in Three Years	799
Operating Leases, Future Minimum Payments, Due in Four Years	793
Operating Leases, Future Minimum Payments, Due in Five Years	695
Operating Leases, Future Minimum Payments, Due Thereafter	953
Operating Leases, Future Minimum Payments Due	4,794
Lessee, Operating Lease, Liability, Undiscounted Excess Amount	(889)
Operating Lease, Liability	$ 3,905		$ 4,058
Operating Lease, Weighted Average Remaining Lease Term	5 years 7 months 6 days		5 years 9 months 18 days
Operating Lease, Weighted Average Discount Rate, Percent	7.20%		7.20%
Operating Lease, Right-of-Use Asset	$ 3,682	$ 3,682	$ 3,838
Operating Lease, Expense	300
Loan commitments, at fair value	3,300	$ 3,299	3,060
Investment in Other Loan Originator
Other Commitments [Line Items]
Unfunded commitment	5,300		6,500
Non-Exchange Traded Equity Investment in Mortgage Originators [Member] | Related party mortgage originator (with flow mortgage loan purchase and sale agreement) [Member]
Other Commitments [Line Items]
Maximum guarantees	15,000
Equity investments in securitization-related risk retention vehicle
Other Commitments [Line Items]
Maximum guarantees	15,500
Drawn down amount being guaranteed	10,800		10,800
Reverse mortgage loans
Other Commitments [Line Items]
Contractual Obligation	1,800,000		1,700,000
Residential mortgage loans
Other Commitments [Line Items]
Unfunded commitment	191,800		175,700
Residential mortgage loans | Investment in unconsolidated entities
Other Commitments [Line Items]
Unfunded commitment	163,000		181,400
Total Purchase Commitment	650,000
Corporate loan [Member]
Other Commitments [Line Items]
Unfunded commitment	4,200		4,200
Corporate loan [Member] | Line of Credit
Other Commitments [Line Items]
Unfunded commitment	900		$ 900
Lending Commitment	$ 1,000