Other Assets (Details) - USD ($) $ in Thousands	Sep. 30, 2019	Mar. 31, 2019	Dec. 31, 2018	Sep. 30, 2018	Mar. 31, 2018	Dec. 31, 2017
Other Assets [Abstract]
REO	$ 376,200	$ 334,069	$ 249,413	$ 223,105	$ 192,162	$ 152,356
Capital contributions made to loan origination partners	122,903		23,210
MBS and loan related receivables	102,715		130,964
Other interest-earning assets	87,896		92,022
Other	45,495		32,176
Total Other Assets	735,209		$ 527,785
Real estate held-for-investment	$ 19,600