Other Assets and Liabilities - REO Information (Details) $ in Thousands	9 Months Ended
	Sep. 30, 2023 USD ($) asset	Dec. 31, 2022 asset
Other Real Estate [Roll Forward]
Balance at beginning of period	$ 6,455
Transfers to REO	53,906
Liquidations	(5,626)
Changes in fair value, net	(612)
Balance at End of Period	54,123
Realized loss from liquidation	$ (600)
Number of REO properties recorded on balance sheet | asset	35	28
Legacy Sequoia
Other Real Estate [Roll Forward]
Balance at beginning of period	$ 544
Transfers to REO	18
Liquidations	(562)
Changes in fair value, net	0
Balance at End of Period	$ 0
Number of REO properties recorded on balance sheet | asset	0	2
Freddie Mac SLST
Other Real Estate [Roll Forward]
Balance at beginning of period	$ 2,899
Transfers to REO	2,340
Liquidations	(2,754)
Changes in fair value, net	380
Balance at End of Period	$ 2,865
Number of REO properties recorded on balance sheet | asset	25	24
CAFL
Other Real Estate [Roll Forward]
Balance at beginning of period	$ 0
Transfers to REO	2,684
Liquidations	0
Changes in fair value, net	0
Balance at End of Period	$ 2,684
Number of REO properties recorded on balance sheet | asset	1	0
BPL bridge loans
Other Real Estate [Roll Forward]
Balance at beginning of period	$ 3,012
Transfers to REO	48,864
Liquidations	(2,310)
Changes in fair value, net	(992)
Balance at End of Period	$ 48,574
Number of REO properties recorded on balance sheet | asset	9	2