Operating Groups - Sales by operating group (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jul. 29, 2023	Jul. 30, 2022	Jul. 29, 2023	Jul. 30, 2022
Operating groups
Net sales	$ 420,319	$ 363,430	$ 840,416	$ 716,011
Operating Segments | Tommy Bahama
Operating groups
Net sales	245,443	243,965	484,878	472,032
Operating Segments | Lilly Pulitzer
Operating groups
Net sales	91,349	88,665	188,799	180,710
Operating Segments | Johnny Was
Operating groups
Net sales	52,023		101,514
Operating Segments | Emerging Brands
Operating groups
Net sales	31,580	29,913	65,571	61,676
Corporate and Other
Operating groups
Net sales	(76)	887	(346)	1,593
Retail
Operating groups
Net sales	$ 170,137	$ 153,976	$ 327,742	$ 290,056
Net sales (as a percent)	41.00%	42.00%	39.00%	41.00%
Retail | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	46.00%	48.00%	45.00%	47.00%
Retail | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	36.00%	40.00%	35.00%	37.00%
Retail | Operating Segments | Johnny Was
Operating groups
Net sales (as a percent)	38.00%		37.00%
Retail | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	12.00%	7.00%	10.00%	6.00%
E-commerce
Operating groups
Net sales	$ 152,264	$ 118,816	$ 278,028	$ 215,289
Net sales (as a percent)	36.00%	33.00%	33.00%	30.00%
E-commerce | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	28.00%	28.00%	24.00%	24.00%
E-commerce | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	50.00%	43.00%	49.00%	43.00%
E-commerce | Operating Segments | Johnny Was
Operating groups
Net sales (as a percent)	43.00%		40.00%
E-commerce | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	48.00%	46.00%	42.00%	38.00%
Food & Beverage
Operating groups
Net sales	$ 29,503	$ 27,291	$ 61,535	$ 58,176
Net sales (as a percent)	7.00%	8.00%	7.00%	8.00%
Food & Beverage | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	12.00%	11.00%	13.00%	12.00%
Wholesale
Operating groups
Net sales	$ 68,312	$ 62,799	$ 173,141	$ 151,415
Net sales (as a percent)	16.00%	17.00%	21.00%	21.00%
Wholesale | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	14.00%	13.00%	18.00%	17.00%
Wholesale | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	14.00%	17.00%	16.00%	20.00%
Wholesale | Operating Segments | Johnny Was
Operating groups
Net sales (as a percent)	19.00%		23.00%
Wholesale | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	40.00%	47.00%	48.00%	56.00%
Other
Operating groups
Net sales	$ 103	$ 548	$ (30)	$ 1,075