Operating Group Information - Financial information (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Nov. 02, 2019	Nov. 03, 2018	Nov. 02, 2019	Nov. 03, 2018
Operating groups
Net sales	$ 241,221	$ 233,662	$ 825,194	$ 808,931
Depreciation and amortization	10,193	10,336	30,179	31,933
Operating income	2,594	3,705	72,595	68,591
Interest expense, net	81	489	1,171	1,872
Earnings before income taxes	2,513	3,216	71,424	66,719
Corporate and Other
Operating groups
Net sales	4,060	3,786	12,187	9,927
Depreciation and amortization	285	304	910	931
Operating income	(3,133)	(3,483)	(13,029)	(12,862)
Tommy Bahama | Operating Segments
Operating groups
Net sales	127,023	123,130	480,623	482,990
Depreciation and amortization	7,073	7,131	20,820	22,457
Operating income	(7,739)	(5,141)	30,671	29,783
Lilly Pulitzer | Operating Segments
Operating groups
Net sales	71,659	68,213	219,809	208,463
Depreciation and amortization	2,554	2,624	7,618	7,727
Operating income	10,988	9,576	46,689	43,823
Lanier Apparel | Operating Segments
Operating groups
Net sales	29,377	29,037	76,871	72,806
Depreciation and amortization	146	144	427	424
Operating income	1,952	2,261	3,387	3,448
Southern Tide | Operating Segments
Operating groups
Net sales	9,102	9,496	35,704	34,745
Depreciation and amortization	135	133	404	394
Operating income	$ 526	$ 492	$ 4,877	$ 4,399