Operating Group Information - Financial information (Details) - USD ($) $ in Thousands	3 Months Ended	12 Months Ended
	May 02, 2020	Jan. 30, 2021	Feb. 01, 2020	Feb. 02, 2019
Operating groups
Net sales		$ 748,833	$ 1,122,790	$ 1,107,466
Depreciation and amortization		59,914	40,287	42,490
Operating income (loss)		(123,849)	93,675	90,592
Interest expense, net		2,028	1,245	2,283
(Loss) earnings before income taxes		(125,877)	92,430	88,309
Total Assets		865,634	1,033,369
Impairment of goodwill and intangible assets		60,452
Corporate and Other
Operating groups
Net sales		24,478	19,829	14,657
Depreciation and amortization		1,336	1,358	1,393
Operating income (loss)		(6,786)	(18,834)	(21,449)
Total Assets		76,705	26,385
LIFO accounting charge (credit)		9,000	1,000	1,000
Tommy Bahama | Operating Segments
Operating groups
Net sales		419,817	676,652	675,358
Depreciation and amortization		46,698	27,852	29,549
Operating income (loss)		(53,310)	53,207	53,139
Total Assets		569,854	668,197
Lilly Pulitzer | Operating Segments
Operating groups
Net sales		231,078	284,700	272,299
Depreciation and amortization		9,965	10,106	10,605
Operating income (loss)		27,702	51,795	47,239
Total Assets		176,467	199,913
Southern Tide
Operating groups
Impairment of goodwill and intangible assets	$ 60,000	60,000	0	0
Southern Tide | Operating Segments
Operating groups
Net sales		34,664	46,409	45,248
Depreciation and amortization		676	549	528
Operating income (loss)		(64,801)	5,554	5,663
Total Assets		31,641	99,667
Lanier Apparel | Operating Segments
Operating groups
Net sales		38,796	95,200	99,904
Depreciation and amortization		1,239	422	415
Operating income (loss)		(26,654)	1,953	$ 6,000
Total Assets		$ 10,967	$ 39,207