Condensed Consolidated Statements of Income (Unaudited) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2016	Jun. 30, 2015	Jun. 30, 2016	Jun. 30, 2015
Income Statement [Abstract]
Interest income	$ 277,477	$ 178,177	$ 467,513	$ 262,550
Interest expense	100,685	81,871	181,913	115,850
Net interest income (expense)	176,792	96,306	285,600	146,700
Impairment
Other-than-temporary impairment (OTTI) on securities	2,819	649	6,073	1,720
Valuation and loss provision on loans and real estate owned	16,825	4,772	23,570	5,749
Total Impairment Charges	19,644	5,421	29,643	7,469
Net interest income after impairment	157,148	90,885	255,957	139,231
Other Income
Change in fair value of investments in excess mortgage servicing rights	(15,263)	356	(7,337)	(1,405)
Change in fair value of investments in excess mortgage servicing rights, equity method investees	(675)	3,095	2,347	8,016
Change in fair value of investments in servicer advances	13,946	24,562	(17,278)	16,893
Gain on consumer loans investment	0	8,510	9,943	18,957
Gain on remeasurement of consumer loans investment	0	0	71,250	0
Gain (loss) on settlement of investments, net	(12,711)	1,201	(27,211)	15,968
Other income (loss), net	(5,020)	(74)	(19,515)	(8,484)
Other Income	(19,723)	37,650	12,199	49,945
Operating Expenses
General and administrative expenses	7,224	21,239	19,305	29,799
Management fee to affiliate	10,008	8,371	20,016	13,497
Incentive compensation to affiliate	4,929	2,391	6,125	6,084
Loan servicing expense	14,119	2,951	15,850	7,842
Total Operating Expenses	36,280	34,952	61,296	57,222
Income (Loss) Before Income Taxes	101,145	93,583	206,860	131,954
Income tax expense (benefit)	7,518	14,306	(2,705)	10,879
Net Income (Loss)	93,627	79,277	209,565	121,075
Noncontrolling Interests in Income of Consolidated Subsidiaries	24,975	4,158	29,177	9,981
Net Income Attributable to Common Stockholders	$ 68,652	$ 75,119	$ 180,388	$ 111,094
Net Income Per Share of Common Stock
Basic (in dollars per share)	$ 0.30	$ 0.37	$ 0.78	$ 0.65
Diluted (in dollars per share)	$ 0.30	$ 0.37	$ 0.78	$ 0.63
Weighted Average Number of Shares of Common Stock Outstanding
Basic (in shares)	230,478,390	200,910,040	230,474,796	171,336,768
Diluted (in shares)	230,839,753	205,169,099	230,689,233	175,206,662
Dividend declared per Share of Common Stock (in dollars per share)	$ 0.46	$ 0.45	$ 0.92	$ 0.83