Borrowings (Details) $ in Thousands			6 Months Ended	12 Months Ended
		Aug. 18, 2017 USD ($)	Jun. 30, 2018 USD ($) counterparties	Dec. 31, 2017 USD ($) counterparties
Borrowings [Line Items]
Total secured borrowings			$ 1,618,000	$ 1,392,000
Number of Counterparties with Outstanding Reverse Repurchase Agreements | counterparties			24	23
Concentration Risk, Reverse Repurchase Agreements			17.00%	19.00%
Number Counterparties With Concentration Risk, Reverse Repurchase Agreements | counterparties			1	1
Investments held with dealers as collateral			$ 1,690,000	$ 1,410,000
Pledged Financial Instruments, Not Separately Reported, Securities For Repurchase Agreements Unsettled			$ 300	10,600
Repurchase Agreements amount at risk threshold			10.00%
Other secured borrowings			$ 95,630	$ 57,909
Minimum [Member]
Borrowings [Line Items]
Reverse Repurchase Agreements Maturity			30 days
Reverse Repurchase Agreements Remaining Terms			2 days	2 days
Reverse Repurchase Agreements Interest Rate			0.38%	(1.25%)
Maximum [Member]
Borrowings [Line Items]
Reverse Repurchase Agreements Maturity			180 days
Reverse Repurchase Agreements Remaining Terms			913 days	1094 days
Reverse Repurchase Agreements Interest Rate			5.59%	4.94%
Reverse Repurchase Agreements [Member]
Borrowings [Line Items]
Cash collateral posted for securities sold under agreements to repurchase	[1],[2]		$ 20,700	$ 18,600
Security Owned and Pledged as Collateral, Fair Value			500	1,300
Securitized Residential Mortgage Loans [Member]
Borrowings [Line Items]
Fair value of Assets Transfered and Accounted for as Secured Borrowings			107,900	132,400
Secured borrowing recourse facility collateralized by unsecured loan portfolio [Member]
Borrowings [Line Items]
Other secured borrowings			$ 11,000
Effective interest rate on borrowing			4.42%
Secured borrowing recourse facility collateralized by unsecured loan portfolio [Member] | Unsecured loans [Member]
Borrowings [Line Items]
Fair value of Assets Transfered and Accounted for as Secured Borrowings			$ 18,600
Non-QM loan securitization [Member]
Borrowings [Line Items]
Other secured borrowings			$ 101,100	$ 125,100
Effective interest rate on borrowing			2.93%	2.89%
Secured borrowing facility collateralized by unsecured loan portfolio [Member]
Borrowings [Line Items]
Other secured borrowings			$ 84,600	$ 57,900
Effective interest rate on borrowing			4.42%	4.34%
Secured borrowing facility collateralized by unsecured loan portfolio [Member] | Unsecured loans [Member]
Borrowings [Line Items]
Fair value of Assets Transfered and Accounted for as Secured Borrowings			$ 141,300	$ 89,700
Senior Notes [Member]
Borrowings [Line Items]
Effective interest rate on borrowing			5.55%
Debt Instrument, Face Amount		$ 86,000
Proceeds from Debt, Net of Issuance Costs		$ 84,700
Debt Instrument, Interest Rate, Stated Percentage		5.25%
Debt Instrument, Maturity Date		Sep. 01, 2022

[1] For the purpose of this presentation, for each row the total amount of financial instruments transferred or pledged and cash collateral (received) or pledged may not exceed the applicable gross amount of assets or (liabilities) as presented here. Therefore, the Company has reduced the amount of financial instruments transferred or pledged as collateral related to the Company's reverse repurchase agreements and cash collateral pledged on the Company's financial derivative liabilities. Total financial instruments transferred or pledged as collateral on the Company's reverse repurchase agreements as of June 30, 2018 and December 31, 2017 were $1.69 billion and $1.41 billion, respectively. As of June 30, 2018 and December 31, 2017, total cash collateral on financial derivative assets excludes excess net cash collateral pledged of $3.1 million and $6.4 million, respectively. As of June 30, 2018 and December 31, 2017, total cash collateral on financial derivative liabilities excludes excess cash collateral pledged of $9.8 million and $16.6 million, respectively.

[2] When collateral is pledged to or pledged by a counterparty, it is often pledged or posted with respect to all positions with such counterparty, and in such cases such collateral cannot be specifically identified as relating to a specific asset or liability. As a result, in preparing the above tables, the Company has made assumptions in allocating pledged or posted collateral among the various rows.