Variable Interest Entities - Deconsolidation of VIEs Assets and Liabilities (Details) - USD ($) $ in Thousands		Dec. 31, 2015	Dec. 09, 2015	Dec. 31, 2014
Variable Interest Entity
Residential loans, held-for-investment	[1]	$ 0		$ 3,365,003
Accrued interest receivable		50,779		66,044
Deferred securitization and financing costs		5,587		13,080
Total assets	[1]	16,772,736		21,231,017
Asset-backed securities issued by securitization trusts	[1]	0		2,929,820
Total liabilities	[1]	$ 14,505,828		$ 18,592,167
Residential Securitizations Deconsolidated
Variable Interest Entity
Residential loans, held-for-investment			$ 3,181,662
Accrued interest receivable			9,889
Deferred securitization and financing costs			4,347
Total assets			3,195,898
Accrued interest and accrued expenses payable			11,413
Asset-backed securities issued by securitization trusts			2,740,797
Total liabilities			$ 2,752,210

[1] As of December 31, 2014, the consolidated balance sheet included assets and liabilities of consolidated variable interest entities (“VIEs”) totaling $3,380,597 and $2,938,512, respectively. The Company deconsolidated these VIEs in 2015. Refer to Note 3 - "Variable Interest Entities" for further discussion.