Carrying Values and Estimated Fair Values of Assets and Liabilities (Detail) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013		Dec. 31, 2012
Assets
Trading securities	$ 124,555		$ 33,172
Available-for-sale securities	1,558,306		1,075,581
MSRs	64,824		5,315
Derivative assets	7,787		2,972
Liabilities
Derivative liabilities	18,167		51,081
Carrying Value
Assets
Trading securities	124,555		33,172
Available-for-sale securities	1,558,306		1,075,581
MSRs	64,824		5,315
Cash and cash equivalents	173,201		81,080
Restricted cash	398		383
Accrued interest receivable	13,475		12,442
Derivative assets	7,787		2,972
REO	3,661	[1]	4,245	[1]
Margin receivable	31,149	[1]	63,424	[1]
Other collateral posted	5,000	[1]
Liabilities
Short-term debt	862,763		551,918
Accrued interest payable	6,366		4,592
Derivative liabilities	18,167		51,081
ABS issued	1,942,962		2,529,941
Commercial borrowings	49,467
Convertible notes	287,500
Other Long-term debt	139,500		139,500
Carrying Value | Residential Loans at Fair Value
Assets
Loans, held-for-sale	402,602		553,576
Carrying Value | Residential Loans at Lower of Cost or Fair Value
Assets
Loans, held-for-sale	1,665		9,082
Carrying Value | Residential Loans Held for Investment
Assets
Loans, held-for-investment	1,762,167		2,272,812
Carrying Value | Commercial Loans at Fair Value
Assets
Loans, held-for-sale	89,111
Carrying Value | Commercial Loans at Lower of Cost or Fair Value
Assets
Loans, held-for-sale			8,500
Carrying Value | Commercial Loans Held For Investment
Assets
Loans, held-for-investment	343,344		304,510
Fair Value
Assets
Trading securities	124,555		33,172
Available-for-sale securities	1,558,306		1,075,581
MSRs	64,824		5,315
Cash and cash equivalents	173,201		81,080
Restricted cash	398		383
Accrued interest receivable	13,475		12,442
Derivative assets	7,787		2,972
REO	4,084	[1]	5,540	[1]
Margin receivable	31,149	[1]	63,424	[1]
Other collateral posted	5,000	[1]
Liabilities
Short-term debt	862,763		551,918
Accrued interest payable	6,366		4,592
Derivative liabilities	18,167		51,081
ABS issued	1,746,906		2,372,971
Commercial borrowings	49,467
Convertible notes	299,719
Other Long-term debt	111,600		90,675
Fair Value | Residential Loans at Fair Value
Assets
Loans, held-for-sale	402,602		553,576
Fair Value | Residential Loans at Lower of Cost or Fair Value
Assets
Loans, held-for-sale	1,817		9,324
Fair Value | Residential Loans Held for Investment
Assets
Loans, held-for-investment	1,610,024		2,062,352
Fair Value | Commercial Loans at Fair Value
Assets
Loans, held-for-sale	89,111
Fair Value | Commercial Loans at Lower of Cost or Fair Value
Assets
Loans, held-for-sale			8,500
Fair Value | Commercial Loans Held For Investment
Assets
Loans, held-for-investment	$ 348,305		$ 309,547

[1] These assets are included in Other Assets on our consolidated balance sheets.