Other Assets (Details) - USD ($) $ in Thousands	Mar. 31, 2016	Dec. 31, 2015	Mar. 31, 2015	Dec. 31, 2014
Other Assets [Abstract]
REO	$ 43,291	$ 28,026	$ 8,333	$ 5,492
Interest receivable	29,126	29,002
Swaps, at fair value	152	1,127
Goodwill	7,189	7,189
Prepaid and other assets	96,324	101,455
Total Other Assets	$ 176,082	$ 166,799