Residential Whole Loans (Carrying Value) (Details) - USD ($) $ in Thousands	12 Months Ended
Dec. 31, 2018	Dec. 31, 2017
Investments, Debt and Equity Securities [Abstract]
Contractually required principal and interest	$ 154,911	$ 534,112
Contractual cash flows not expected to be collected (non-accretable yield)	(15,378)	(129,547)
Expected cash flows to be collected	139,533	404,565
Interest component of expected cash flows (accretable yield)	(41,947)	(137,378)
Fair value at the date of acquisition	$ 97,586	$ 267,187

Amount of additions to the excess of a loan's cash flows expected to be collected over the investor's initial investment in acquired loans not accounted for as debt securities with evidence of deterioration of credit quality.

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 30
-Section 15
-Paragraph 2
-URI http://asc.fasb.org/extlink&oid=82894507&loc=d3e13503-111538

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 30
-Section 50
-Paragraph 2
-Subparagraph (a)(2)
-URI http://asc.fasb.org/extlink&oid=82894903&loc=d3e15032-111544

+ Details

Name:	us-gaap_CertainLoansAcquiredInTransferNotAccountedForAsDebtSecuritiesAccretableYieldAdditions
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	duration

- Definition

Amount of increase of reclassification from nonaccretable difference to the excess of a loan's cash flows expected to be collected over the investor's initial investment in acquired loans not accounted for as debt securities with evidence of deterioration of credit quality.

+ References

+ Details

Name:	us-gaap_CertainLoansAcquiredInTransferNotAccountedForAsDebtSecuritiesAccretableYieldReclassificationsFromNonaccretableDifference
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	duration

- Definition

Amount of cash flows expected to be collected at acquisition of acquired loans not accounted for as debt securities with evidence of deterioration of credit quality.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 30
-Section 15
-Paragraph 2
-URI http://asc.fasb.org/extlink&oid=82894507&loc=d3e13503-111538

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 30
-Section 50
-Paragraph 2
-Subparagraph (a)(3)
-URI http://asc.fasb.org/extlink&oid=82894903&loc=d3e15032-111544

+ Details

Name:	us-gaap_CertainLoansAcquiredInTransferNotAccountedForAsDebtSecuritiesAcquiredDuringPeriodCashFlowsExpectedToBeCollectedAtAcquisition
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Fair value at acquisition of acquired consumer loans not accounted for as debt securities with evidence of deterioration of credit quality.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 30
-Section 50
-Paragraph 2
-Subparagraph (a)(3)
-URI http://asc.fasb.org/extlink&oid=82894903&loc=d3e15032-111544

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 30
-Section 15
-Paragraph 2
-URI http://asc.fasb.org/extlink&oid=82894507&loc=d3e13503-111538

+ Details

Name:	us-gaap_CertainLoansAcquiredInTransferNotAccountedForAsDebtSecuritiesAcquiredDuringPeriodConsumerAtAcquisitionAtFairValue
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount of contractually required payments receivable at acquisition of acquired loans not accounted for as debt securities with evidence of deterioration of credit quality.

+ References

+ Details

Name:	us-gaap_CertainLoansAcquiredInTransferNotAccountedForAsDebtSecuritiesAcquiredDuringPeriodContractuallyRequiredPaymentsReceivableAtAcquisition
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- References

No definition available.

+ Details

Name:	us-gaap_InvestmentsDebtAndEquitySecuritiesAbstract
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration