Operating Group Information - Financial information (Details) - USD ($) $ in Thousands	3 Months Ended
	May 02, 2020	May 04, 2019	Feb. 01, 2020
Operating groups
Net sales	$ 160,343	$ 281,973
Depreciation and amortization	10,693	10,137
Operating income (loss)	(85,489)	29,742
Interest expense, net	658	671
(Loss) earnings before income taxes	(86,147)	29,071
Total Assets	1,097,470	1,024,425	$ 1,033,369
Impairment of goodwill and intangible assets	60,452
Corporate and Other
Operating groups
Net sales	5,184	4,360
Depreciation and amortization	331	340
Operating income (loss)	(270)	(4,586)
Total Assets	167,634	(18,584)	22,059
Tommy Bahama | Operating Segments
Operating groups
Net sales	86,984	164,730
Depreciation and amortization	7,800	6,840
Operating income (loss)	(23,362)	15,192
Total Assets	650,057	677,402	668,197
Lilly Pulitzer | Operating Segments
Operating groups
Net sales	49,149	72,595
Depreciation and amortization	2,316	2,683
Operating income (loss)	4,146	15,252
Total Assets	202,983	216,635	199,913
Lanier Apparel | Operating Segments
Operating groups
Net sales	10,725	26,154
Depreciation and amortization	102	140
Operating income (loss)	(2,637)	1,367
Total Assets	39,283	49,232	43,533
Southern Tide | Operating Segments
Operating groups
Net sales	8,301	14,134
Depreciation and amortization	144	134
Operating income (loss)	(63,366)	2,517
Total Assets	$ 37,513	$ 99,740	$ 99,667