Repurchase Agreements (Undrawn Financing Commitment) (Details) - USD ($) $ in Thousands	3 Months Ended
Mar. 31, 2019	Dec. 31, 2018
Debt Instrument [Line Items]
Repurchase agreements	$ 8,509,713	$ 7,879,087
MSR Asset Financing
Debt Instrument [Line Items]
Repurchase agreement, borrowing commitment	$ 75,000
MSR Asset Financing \| Minimum
Debt Instrument [Line Items]
Commitment fee	0.125%
MSR Asset Financing \| Maximum
Debt Instrument [Line Items]
Commitment fee	0.50%
MSR-related assets
Debt Instrument [Line Items]
Repurchase agreements	$ 647,535	$ 474,127
MSR-related assets \| Corporate Loan
Debt Instrument [Line Items]
Repurchase agreements	$ 53,800

Amount, after the effects of master netting arrangements, of funds outstanding borrowed in the form of a security repurchase agreement between the entity and another party for the sale and repurchase of identical or substantially the same securities at a date certain for a specified price. Includes liabilities not subject to a master netting arrangement and not elected to be offset.

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 55
-Paragraph 10
-URI http://asc.fasb.org/extlink&oid=99393222&loc=SL20226008-175313

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 50
-Paragraph 3
-Subparagraph (c)
-URI http://asc.fasb.org/extlink&oid=51824906&loc=SL20225862-175312

Reference 3: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 45
-Paragraph 11
-URI http://asc.fasb.org/extlink&oid=49176635&loc=d3e9760-107771

Reference 4: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 942
-SubTopic 210
-Section S99
-Paragraph 1
-Subparagraph (SX 210.9-03.13(1))
-URI http://asc.fasb.org/extlink&oid=6876686&loc=d3e534808-122878

Reference 5: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 235
-SubTopic 10
-Section S99
-Paragraph 1
-Subparagraph (SX 210.4-08.(m)(1)(a)(i))
-URI http://asc.fasb.org/extlink&oid=26873400&loc=d3e23780-122690

Name:	us-gaap_SecuritiesSoldUnderAgreementsToRepurchase
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant