Residential Mortgage Securities and MSR-Related Assets (Sale of MBS) (Details) - USD ($) $ in Thousands	3 Months Ended	6 Months Ended
Jun. 30, 2020	Jun. 30, 2019	Jun. 30, 2020	Jun. 30, 2019
Debt Securities, Available-for-sale [Line Items]
Sales Proceeds	$ 1,798,101	$ 195,333	$ 3,062,742	$ 404,796
Gains/(Losses)	129,666	7,710	61,649	32,319
Agency MBS
Debt Securities, Available-for-sale [Line Items]
Sales Proceeds	535,742	103,345	1,500,875	103,345
Gains/(Losses)	3,563	(2,272)	(19,291)	(2,272)
Non-Agency MBS
Debt Securities, Available-for-sale [Line Items]
Sales Proceeds	1,054,980	70,818	1,318,842	196,912
Gains/(Losses)	151,095	8,823	107,951	26,976
CRT securities
Debt Securities, Available-for-sale [Line Items]
Sales Proceeds	207,379	21,170	243,025	104,539
Gains/(Losses)	$ (24,992)	$ 1,159	$ (27,011)	$ 7,615

Net gain (loss) resulting from the sales of securitized, pay-through debt securities collateralized by real estate mortgage loans (mortgages).

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 942
-SubTopic 220
-Section S99
-Paragraph 1
-Subparagraph (SX 210.9-04.13(h))
-URI http://asc.fasb.org/extlink&oid=120399700&loc=SL114874048-224260

+ Details

Name:	us-gaap_GainLossOnSalesOfMortgageBackedSecuritiesMBS
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	duration

- Definition

Amount of cash inflow from sale of investment in mortgage-backed security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 230
-SubTopic 10
-Section 45
-Paragraph 12
-Subparagraph (a)
-URI http://asc.fasb.org/extlink&oid=121586364&loc=d3e3179-108585

+ Details

Name:	us-gaap_ProceedsFromSaleOfMortgageBackedSecuritiesMBSCategorizedAsAvailableForSale
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	duration

- Definition

Line items represent financial concepts included in a table. These concepts are used to disclose reportable information associated with domain members defined in one or many axes to the table.

+ References

No definition available.

+ Details

Name:	us-gaap_ScheduleOfAvailableForSaleSecuritiesLineItems
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_MortgageBackedSecuritiesIssuedByUSGovernmentSponsoredEnterprisesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_MortgageBackedSecuritiesIssuedByPrivateEnterprisesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_USGovernmentSponsoredEnterprisesDebtSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type: