CONSOLIDATED STATEMENTS OF OPERATIONS - USD ($) shares in Thousands, $ in Thousands	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Interest and other income:
Interest-Agency MBS	$ 90,173	$ 95,656	$ 76,657
Interest-Non-Agency MBS	38,038	40,733	38,266
Interest-residential securitized mortgage loans	20,443	23,463	27,720
Interest-residential mortgage loans held-for-securitization	4,314
Other interest income	1,427	120	105
Interest and Dividend Income, Operating, Total	154,395	159,972	142,748
Interest expense:
Interest expense on repurchase agreements	92,737	90,511	53,954
Interest expense on asset-backed securities	19,771	22,800	26,939
Interest expense on warehouse line of credit	4,148
Interest expense on junior subordinated notes	2,100	1,996	1,626
Interest Expense, Total	118,756	115,307	82,519
Net interest income	35,639	44,665	60,229
Operating expenses:
Management fee to related party	(6,699)	(7,098)	(7,503)
Rental properties depreciation and expenses	(1,517)	(1,525)	(1,372)
General and administrative expenses	(5,090)	(4,880)	(4,430)
Total operating expenses	(13,306)	(13,503)	(13,305)
Other (loss) income:
Income-rental properties	1,800	1,761	1,710
Impairment charge on Non-Agency MBS	(2,108)	(2,869)	(2,399)
Gain on sale of residential mortgage loans held-for-investment through consolidated securitization trusts			378
Gain on sale of residential properties	31	54
Gain on sale of residential properties	31	54
(Loss) gain on derivatives, net	(84,741)	(8,071)	7,132
Recovery on Non-Agency MBS		1	2
Total other (loss) income	(77,752)	(37,650)	7,448
Net (loss) income	(55,419)	(6,488)	54,372
Dividends on preferred stock	(9,189)	(9,189)	(8,173)
Net (loss) income to common stockholders	$ (64,608)	$ (15,677)	$ 46,199
Basic (loss) income per common share	$ (0.65)	$ (0.16)	$ 0.48
Diluted (loss) income per common share	$ (0.65)	$ (0.16)	$ 0.47
Basic weighted average number of shares outstanding	98,739	98,314	96,764
Diluted weighted average number of shares outstanding	98,739	98,314	100,479
Agency MBS
Other (loss) income:
Realized net gain (loss) on sale of MBS	$ (3,983)	$ (12,186)	$ (2,168)
Realized (loss) on sales of Agency MBS held as trading investments	(5,787)	(11,429)
Unrealized gain (loss) on Agency MBS held as trading investments	$ 17,036	$ (4,911)	$ 2,793