Income Taxes - Reconciliation Schedule (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2018	Dec. 31, 2017	Dec. 31, 2016
Income Tax Disclosure [Abstract]
Income taxes at statutory rates	$ (9,317)	$ (2,987)	$ (3,676)
Earnings from REIT - not subject to tax	9,015	(425)	(672)
State income taxes, net of federal income tax benefit	(187)	(445)	615
Provision to return	360	(205)	(416)
Rate and permanent differences on non-U.S. earnings	(1,228)	668	1,739
Valuation allowance	(2,227)	2,950	(1,542)
Non-deductible expenses	4,021	(2,345)	(873)
Change in uncertain tax positions	347	94	564
Amended returns/refunds	0	0	360
Effect of Tax Cuts and Jobs Act	3,797	(3,113)	0
Quarry tax basis in land	0	0	(3,025)
Investment in foreign subsidiary	0	0	616
REIT excise tax	0	(4,772)	0
Other	(962)	1,187	431
Total income tax benefit (expense)	$ 3,619	$ (9,393)	$ (5,879)