Securitization Transactions (Schedule of Residential Loan Securitizations) (Details) - Non-QM loan securitization $ in Thousands	3 Months Ended
	Mar. 31, 2020 USD ($)
November 2018 [Member]
Securitization Transactions [Line Items]
Total Face Amount of Certificates Issued	$ 232,518
Economic interest retained	5.70%
Purchase of certificates	$ 1,300
June 2019 [Member]
Securitization Transactions [Line Items]
Total Face Amount of Certificates Issued	$ 226,913
Economic interest retained	6.10%
Purchase of certificates	$ 1,200
November 2019 [Member]
Securitization Transactions [Line Items]
Total Face Amount of Certificates Issued	$ 267,255
Economic interest retained	6.40%
Purchase of certificates	$ 1,700
The Company [Member] | November 2018 [Member]
Securitization Transactions [Line Items]
Principal Balance of Loans Transferred to the Depositor	232,518
The Company [Member] | June 2019 [Member]
Securitization Transactions [Line Items]
Principal Balance of Loans Transferred to the Depositor	226,913
The Company [Member] | November 2019 [Member]
Securitization Transactions [Line Items]
Principal Balance of Loans Transferred to the Depositor	$ 267,255