Distressed and Other Residential Mortgage Loans, Net - Allowance for Loan Losses on Residential Mortgage Loans Held in Securitization Trusts (Details) - USD ($) $ in Thousands	6 Months Ended
Jun. 30, 2019	Jun. 30, 2018
Allowance for Loan and Lease Losses [Roll Forward]
Balance at beginning of period	$ 3,759	$ 4,191
Provision for (recovery of) loan losses	38	(110)
Transfer to real estate owned	(167)	0
Charge-offs	(109)	(237)
Balance at the end of period	$ 3,521	$ 3,844

A roll forward is a reconciliation of a concept from the beginning of a period to the end of a period.

No definition available.

Name:	us-gaap_AllowanceForLoanAndLeaseLossesRollForward
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Amount of allowance for credit loss on financing receivable. Excludes allowance for financing receivable covered under loss sharing agreement.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 50
-Paragraph 11B
-Subparagraph (c)(1)
-URI http://asc.fasb.org/extlink&oid=118936363&loc=SL6953423-111524

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 45
-Paragraph 1
-URI http://asc.fasb.org/extlink&oid=118955202&loc=SL82895884-210446

Reference 3: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 50
-Paragraph 13
-Subparagraph (a)
-URI http://asc.fasb.org/extlink&oid=119407570&loc=SL82919249-210447

Reference 4: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 942
-SubTopic 210
-Section S99
-Paragraph 1
-Subparagraph (SX 210.9-03(7)(d))
-URI http://asc.fasb.org/extlink&oid=6876686&loc=d3e534808-122878

Reference 5: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 50
-Paragraph 13
-Subparagraph (f)
-URI http://asc.fasb.org/extlink&oid=119407570&loc=SL82919249-210447

+ Details

Name:	us-gaap_FinancingReceivableAllowanceForCreditLosses
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of writeoff of financing receivable, charged against allowance for credit loss.

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 50
-Paragraph 13
-Subparagraph (d)
-URI http://asc.fasb.org/extlink&oid=119407570&loc=SL82919249-210447

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 50
-Paragraph 11B
-Subparagraph (c)(3)
-URI http://asc.fasb.org/extlink&oid=118936363&loc=SL6953423-111524

Reference 3: http://www.xbrl.org/2003/role/exampleRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 55
-Paragraph 79
-URI http://asc.fasb.org/extlink&oid=118955255&loc=SL82922352-210448

Reference 4: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 942
-SubTopic 210
-Section S99
-Paragraph 1
-Subparagraph (SX 210.9-03(7)(d))
-URI http://asc.fasb.org/extlink&oid=6876686&loc=d3e534808-122878

+ Details

Name:	us-gaap_FinancingReceivableAllowanceForCreditLossesWriteOffs
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	duration

- Definition

Amount of financing receivable reclassified to held-for-sale.

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 50
-Paragraph 11
-Subparagraph (i)
-URI http://asc.fasb.org/extlink&oid=119407570&loc=SL82919244-210447

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 50
-Paragraph 11B
-Subparagraph (f)
-URI http://asc.fasb.org/extlink&oid=118936363&loc=SL6953423-111524

+ Details

Name:	us-gaap_FinancingReceivableReclassificationToHeldForSale
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	duration

- Definition

Amount of expense related loan transactions, lease transactions, credit loss from transactions other than loan and lease transactions, and other loss based on assessment of uncollectability from the counterparty to reduce the account to their net realizable value.

+ References

+ Details

Name:	us-gaap_ProvisionForLoanLeaseAndOtherLosses
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	duration