Mortgage-Backed Securities - Unrealized Loss Positions (Details) $ in Thousands	Jun. 30, 2024 USD ($) security	Dec. 31, 2023 USD ($) security
Debt Securities, Available-for-sale [Line Items]
Unrealized Loss Position for Less than 12 Months, Estimated Fair Value	$ 529,107	$ 136,549
Unrealized Loss Position for Less than 12 Months, Unrealized Losses	$ (4,625)	$ (10,352)
Unrealized Loss Position for Less than 12 Months, Number of Positions | security	41	52
Unrealized Loss Position for 12 Months or More, Estimated Fair Value	$ 300,623	$ 306,074
Unrealized Loss Position for 12 Months or More, Unrealized Losses	$ (135,375)	$ (129,176)
Unrealized Loss Position for 12 Months or More, Number of Positions | security	206	186
Total, Estimated Fair Value	$ 829,730	$ 442,623
Total, Unrealized Losses	$ (140,000)	$ (139,528)
Total, Number of Positions | security	247	238
Residential Mortgage-Backed Securities | Non-Agency RMBS - Senior
Debt Securities, Available-for-sale [Line Items]
Unrealized Loss Position for Less than 12 Months, Estimated Fair Value	$ 65,819	$ 51,476
Unrealized Loss Position for Less than 12 Months, Unrealized Losses	$ (347)	$ (281)
Unrealized Loss Position for Less than 12 Months, Number of Positions | security	15	13
Unrealized Loss Position for 12 Months or More, Estimated Fair Value	$ 39,090	$ 42,859
Unrealized Loss Position for 12 Months or More, Unrealized Losses	$ (6,168)	$ (6,700)
Unrealized Loss Position for 12 Months or More, Number of Positions | security	7	6
Total, Estimated Fair Value	$ 104,910	$ 94,335
Total, Unrealized Losses	$ (6,515)	$ (6,981)
Total, Number of Positions | security	22	19
Residential Mortgage-Backed Securities | Non-Agency RMBS - Subordinated
Debt Securities, Available-for-sale [Line Items]
Unrealized Loss Position for Less than 12 Months, Estimated Fair Value	$ 12,781	$ 19,382
Unrealized Loss Position for Less than 12 Months, Unrealized Losses	$ (652)	$ (1,467)
Unrealized Loss Position for Less than 12 Months, Number of Positions | security	2	5
Unrealized Loss Position for 12 Months or More, Estimated Fair Value	$ 175,240	$ 181,822
Unrealized Loss Position for 12 Months or More, Unrealized Losses	$ (27,992)	$ (35,081)
Unrealized Loss Position for 12 Months or More, Number of Positions | security	32	33
Total, Estimated Fair Value	$ 188,021	$ 201,204
Total, Unrealized Losses	$ (28,644)	$ (36,548)
Total, Number of Positions | security	34	38
Residential Mortgage-Backed Securities | Non-Agency RMBS - Interest-only
Debt Securities, Available-for-sale [Line Items]
Unrealized Loss Position for Less than 12 Months, Estimated Fair Value	$ 7,678	$ 19,263
Unrealized Loss Position for Less than 12 Months, Unrealized Losses	$ (1,959)	$ (4,035)
Unrealized Loss Position for Less than 12 Months, Number of Positions | security	13	27
Unrealized Loss Position for 12 Months or More, Estimated Fair Value	$ 36,408	$ 36,731
Unrealized Loss Position for 12 Months or More, Unrealized Losses	$ (90,896)	$ (77,455)
Unrealized Loss Position for 12 Months or More, Number of Positions | security	124	105
Total, Estimated Fair Value	$ 44,086	$ 55,994
Total, Unrealized Losses	$ (92,855)	$ (81,490)
Total, Number of Positions | security	137	132
Residential Mortgage-Backed Securities | Agency RMBS - CMO
Debt Securities, Available-for-sale [Line Items]
Unrealized Loss Position for Less than 12 Months, Estimated Fair Value	$ 437,328
Unrealized Loss Position for Less than 12 Months, Unrealized Losses	$ (689)
Unrealized Loss Position for Less than 12 Months, Number of Positions | security	5
Unrealized Loss Position for 12 Months or More, Estimated Fair Value	$ 0
Unrealized Loss Position for 12 Months or More, Unrealized Losses	$ 0
Unrealized Loss Position for 12 Months or More, Number of Positions | security	0
Total, Estimated Fair Value	$ 437,328
Total, Unrealized Losses	$ (689)
Total, Number of Positions | security	5
Residential Mortgage-Backed Securities | Agency RMBS - Interest-only
Debt Securities, Available-for-sale [Line Items]
Unrealized Loss Position for Less than 12 Months, Estimated Fair Value	$ 0	$ 0
Unrealized Loss Position for Less than 12 Months, Unrealized Losses	$ 0	$ 0
Unrealized Loss Position for Less than 12 Months, Number of Positions | security	0	0
Unrealized Loss Position for 12 Months or More, Estimated Fair Value	$ 9,564	$ 9,151
Unrealized Loss Position for 12 Months or More, Unrealized Losses	$ (4,868)	$ (5,077)
Unrealized Loss Position for 12 Months or More, Number of Positions | security	8	8
Total, Estimated Fair Value	$ 9,563	$ 9,151
Total, Unrealized Losses	$ (4,868)	$ (5,077)
Total, Number of Positions | security	8	8
Commercial Mortgage Backed Securities | Agency CMBS - Project loans
Debt Securities, Available-for-sale [Line Items]
Unrealized Loss Position for Less than 12 Months, Estimated Fair Value	$ 5,437	$ 43,827
Unrealized Loss Position for Less than 12 Months, Unrealized Losses	$ (777)	$ (4,040)
Unrealized Loss Position for Less than 12 Months, Number of Positions | security	5	5
Unrealized Loss Position for 12 Months or More, Estimated Fair Value	$ 38,221	$ 35,353
Unrealized Loss Position for 12 Months or More, Unrealized Losses	$ (4,753)	$ (4,601)
Unrealized Loss Position for 12 Months or More, Number of Positions | security	32	32
Total, Estimated Fair Value	$ 43,658	$ 79,180
Total, Unrealized Losses	$ (5,530)	$ (8,641)
Total, Number of Positions | security	37	37
Commercial Mortgage Backed Securities | Agency CMBS - Interest-only
Debt Securities, Available-for-sale [Line Items]
Unrealized Loss Position for Less than 12 Months, Estimated Fair Value	$ 64	$ 2,601
Unrealized Loss Position for Less than 12 Months, Unrealized Losses	$ (201)	$ (529)
Unrealized Loss Position for Less than 12 Months, Number of Positions | security	1	2
Unrealized Loss Position for 12 Months or More, Estimated Fair Value	$ 2,100	$ 158
Unrealized Loss Position for 12 Months or More, Unrealized Losses	$ (698)	$ (262)
Unrealized Loss Position for 12 Months or More, Number of Positions | security	3	2
Total, Estimated Fair Value	$ 2,164	$ 2,759
Total, Unrealized Losses	$ (899)	$ (791)
Total, Number of Positions | security	4	4