Investment in Securities (Unrealized Loss Positions Securities) (Details) - USD ($) $ in Thousands	Jun. 30, 2021	Dec. 31, 2020
Securities, Available-for-sale [Line Items]
Fair Value, Less than 12 Months	$ 714,471	$ 153,786
Unrealized Losses, Less than 12 Months	(9,081)	(4,358)
Fair Value, Greater than 12 Months	10,278	4,627
Unrealized Losses, Greater than 12 Months	(3,906)	(1,523)
Fair Value, Total	724,749	158,413
Unrealized Loss, Total	(12,987)	(5,881)
Agency RMBS
Securities, Available-for-sale [Line Items]
Fair Value, Less than 12 Months	703,563	126,926
Unrealized Losses, Less than 12 Months	(8,569)	(981)
Fair Value, Greater than 12 Months	347	832
Unrealized Losses, Greater than 12 Months	(13)	(44)
Fair Value, Total	703,910	127,758
Unrealized Loss, Total	(8,582)	(1,025)
Non-Agency RMBS
Securities, Available-for-sale [Line Items]
Fair Value, Less than 12 Months	10,865	20,474
Unrealized Losses, Less than 12 Months	(487)	(2,616)
Fair Value, Greater than 12 Months	2,817	2,599
Unrealized Losses, Greater than 12 Months	(219)	(348)
Fair Value, Total	13,682	23,073
Unrealized Loss, Total	(706)	(2,964)
CLOs
Securities, Available-for-sale [Line Items]
Fair Value, Less than 12 Months	43	5,279
Unrealized Losses, Less than 12 Months	(20)	(753)
Fair Value, Greater than 12 Months	7,114	1,196
Unrealized Losses, Greater than 12 Months	(3,674)	(1,131)
Fair Value, Total	7,157	6,475
Unrealized Loss, Total	(3,694)	(1,884)
Other Securities
Securities, Available-for-sale [Line Items]
Fair Value, Less than 12 Months	0	1,107
Unrealized Losses, Less than 12 Months	(5)	(8)
Fair Value, Greater than 12 Months	0	0
Unrealized Losses, Greater than 12 Months	0	0
Fair Value, Total	0	1,107
Unrealized Loss, Total	$ (5)	$ (8)