Operating Group Information - Sales by operating group (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jul. 30, 2022	Jul. 31, 2021	Jul. 30, 2022	Jul. 31, 2021
Operating groups
Net sales	$ 363,430	$ 328,672	$ 716,011	$ 594,434
Operating Segments | Tommy Bahama
Operating groups
Net sales	243,965	208,833	472,032	365,531
Operating Segments | Lilly Pulitzer
Operating groups
Net sales	88,665	87,333	180,710	160,909
Operating Segments | Emerging Brands
Operating groups
Net sales	29,913	22,822	61,676	45,253
Operating Segments | Lanier Apparel
Operating groups
Net sales		8,492		20,511
Corporate and Other
Operating groups
Net sales	887	1,192	1,593	2,230
Retail
Operating groups
Net sales	$ 153,976	$ 135,634	$ 290,056	$ 226,914
Net sales (as a percent)	42.00%	41.00%	41.00%	38.00%
Retail | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	48.00%	48.00%	47.00%	45.00%
Retail | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	40.00%	38.00%	37.00%	37.00%
Retail | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	7.00%	6.00%	6.00%	4.00%
E-commerce
Operating groups
Net sales	$ 118,816	$ 104,753	$ 215,289	$ 178,991
Net sales (as a percent)	33.00%	32.00%	30.00%	30.00%
E-commerce | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	28.00%	27.00%	24.00%	25.00%
E-commerce | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	43.00%	46.00%	43.00%	44.00%
E-commerce | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	46.00%	41.00%	38.00%	38.00%
Restaurant
Operating groups
Net sales	$ 27,291	$ 25,828	$ 58,176	$ 51,036
Net sales (as a percent)	8.00%	8.00%	8.00%	9.00%
Restaurant | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	11.00%	12.00%	12.00%	14.00%
Wholesale
Operating groups
Net sales	$ 62,799	$ 62,022	$ 151,415	$ 136,475
Net sales (as a percent)	17.00%	19.00%	21.00%	23.00%
Wholesale | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	13.00%	13.00%	17.00%	16.00%
Wholesale | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	17.00%	16.00%	20.00%	19.00%
Wholesale | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	47.00%	53.00%	56.00%	58.00%
Wholesale | Operating Segments | Lanier Apparel
Operating groups
Net sales (as a percent)		100.00%		100.00%
Wholesale | Corporate and Other
Operating groups
Net sales (as a percent)	57.00%	75.00%	51.00%	64.00%
Other
Operating groups
Net sales	$ 548	$ 435	$ 1,075	$ 1,018
Other | Corporate and Other
Operating groups
Net sales (as a percent)	43.00%	25.00%	49.00%	36.00%