Securitization Transactions (Schedule of Residential Loan Securitizations) (Details) - Non-QM loan securitization $ in Thousands	9 Months Ended
	Sep. 30, 2020 USD ($)
November 2018 [Member]
Securitization Transactions [Line Items]
Total Face Amount of Certificates Issued	$ 232,518
Economic interest retained	5.70%
Purchase of certificates	$ 1,300
June 2019 [Member]
Securitization Transactions [Line Items]
Total Face Amount of Certificates Issued	$ 226,913
Economic interest retained	6.10%
Purchase of certificates	$ 1,200
November 2019 [Member]
Securitization Transactions [Line Items]
Total Face Amount of Certificates Issued	$ 267,255
Economic interest retained	6.40%
Purchase of certificates	$ 1,700
June 2020 [Member]
Securitization Transactions [Line Items]
Total Face Amount of Certificates Issued	259,273
Purchase of certificates	1,900
The Company [Member] | November 2018 [Member]
Securitization Transactions [Line Items]
Principal Balance of Loans Transferred to the Depositor	232,518
The Company [Member] | June 2019 [Member]
Securitization Transactions [Line Items]
Principal Balance of Loans Transferred to the Depositor	226,913
The Company [Member] | November 2019 [Member]
Securitization Transactions [Line Items]
Principal Balance of Loans Transferred to the Depositor	267,255
The Company [Member] | June 2020 [Member]
Securitization Transactions [Line Items]
Principal Balance of Loans Transferred to the Depositor	$ 259,273
Retained, non-risk retention [Member] | June 2020 [Member]
Securitization Transactions [Line Items]
Economic interest retained	3.50%
Retained, risk retention rules [Member] | June 2020 [Member]
Securitization Transactions [Line Items]
Economic interest retained	8.00%