Real Estate Owned - Activity (Details) - USD ($) $ in Thousands	3 Months Ended	9 Months Ended
	Sep. 30, 2015	Sep. 30, 2015	Sep. 30, 2014
Real Estate Owned [Roll Forward]
Balance at beginning of period	$ 8,857	$ 5,492
Adjustments to record at lower of cost or fair value	(560)	(1,939)
Transfer from residential whole loans	5,892	12,894	$ 0
Purchases and capital improvements	2,052	2,052
Disposals	(1,716)	(3,974)
Balance at end of period	14,525	14,525
Gain recorded on transfer from residential whole loans to real estate owned	$ 110	$ 704