Repurchase Agreements (Borrowings Under Repurchase Agreement And Associated Assets Pledged as Collateral) (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2019	Mar. 31, 2018	Dec. 31, 2018
Assets Sold under Agreements to Repurchase [Line Items]
Balance of repurchase agreements	$ 8,509,713		$ 7,879,087
Fair value of securities pledged as collateral under repurchase agreements	10,300,000		9,500,000
Total Fair Value of Assets Pledged and Accrued Interest	41,300		33,100
Agency MBS
Assets Sold under Agreements to Repurchase [Line Items]
Balance of repurchase agreements	2,353,173		2,384,357
Fair value of securities pledged as collateral under repurchase agreements	$ 2,524,612		$ 2,572,597
Weighted average haircut (percent)	4.49%		4.60%
Non-Agency MBS
Assets Sold under Agreements to Repurchase [Line Items]
Balance of repurchase agreements	$ 1,359,699		$ 1,447,585
Fair value of securities pledged as collateral under repurchase agreements	$ 1,782,770		$ 1,871,650
Weighted average haircut (percent)	20.50%		21.38%
RPL/NPL MBS
Assets Sold under Agreements to Repurchase [Line Items]
Balance of repurchase agreements	$ 1,009,331		$ 1,084,532
Fair value of securities pledged as collateral under repurchase agreements	$ 1,285,524		$ 1,377,250
Weighted average haircut (percent)	21.23%		21.31%
CRT securities
Assets Sold under Agreements to Repurchase [Line Items]
Balance of repurchase agreements	$ 338,827		$ 391,586
Fair value of securities pledged as collateral under repurchase agreements	$ 419,877		$ 480,315
Weighted average haircut (percent)	19.49%		20.01%
Residential whole loans
Assets Sold under Agreements to Repurchase [Line Items]
Balance of repurchase agreements	$ 2,746,804		$ 2,020,508
Fair value of securities pledged as collateral under repurchase agreements	$ 3,321,187		$ 2,441,931
Weighted average haircut (percent)	15.54%		16.55%
MSR-related assets
Assets Sold under Agreements to Repurchase [Line Items]
Balance of repurchase agreements	$ 647,535		$ 474,127
Fair value of securities pledged as collateral under repurchase agreements	$ 825,363		$ 611,807
Weighted average haircut (percent)	21.35%		21.88%
Other Interest Earning Assets
Assets Sold under Agreements to Repurchase [Line Items]
Balance of repurchase agreements	$ 54,386		$ 76,419
Fair value of securities pledged as collateral under repurchase agreements	$ 49,373		$ 81,494
Weighted average haircut (percent)	21.61%		21.15%
Repurchase Agreement Borrowings
Assets Sold under Agreements to Repurchase [Line Items]
Weighted average remaining term-to-interest rate reset of borrowings under repurchase agreements, days	28 days	31 days
Effective repricing period, months	5 months	8 months
Balance of repurchase agreements	$ 8,509,755		$ 7,879,114
Unamortized debt issuance expense	42		27
Loan Securitization
Assets Sold under Agreements to Repurchase [Line Items]
Fair value of securities pledged as collateral under repurchase agreements	27,000		27,000
Residential Loans At Fair Value | Securities Sold under Agreements to Repurchase and Other Advances [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Fair Value	2,500,000		1,700,000
Amortized Cost	2,400,000		1,600,000
Total Fair Value of Assets Pledged and Accrued Interest	$ 822,200		$ 738,600