Other Income (Expense) - Components (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Investment income, net
Interest and dividend income	$ 7,375	$ 9,060	$ 16,380
Accretion income	84	684	1,983
Net realized gain (loss) on the sale of investments	87	(973)	10,750
Other-than-temporary impairment loss		(2,330)
Other-than-temporary impairment loss			(2,288)
Unrealized (loss) gain on investments, net	(5,342)	(3,035)
Interest income from investments in SPEs	8,190	8,197	8,201
Interest accrued on notes receivable and other interest	320	547	384
Total investment income, net	10,714	12,150	35,410
Interest expense
Interest expense and amortization of discount and issuance costs for Senior Notes issued by SPE	(8,801)	(8,788)	(8,777)
Other interest expense	(3,501)	(3,052)	(3,368)
Total interest expense	(12,302)	(11,840)	(12,145)
Sale of vacation rental management, net			9,800
Other income (expense), net
Gain on land contribution to equity method investment	2,317
Accretion income from retained interest investments	1,325	1,232	1,100
Gain on insurance recovery	5,314	7,199
Loss from hurricane damage	2,704	8,628
Miscellaneous income (expense), net	198	1,349	3,613
Other income, net	6,450	1,152	4,713
Total other income, net	$ 4,862	$ 1,462	$ 37,778