Operating Groups - Sales by operating group (Details) - USD ($) $ in Thousands	12 Months Ended
	Jan. 28, 2023	Jan. 29, 2022	Jan. 30, 2021
Operating groups
Net sales	$ 1,411,528	$ 1,142,079	$ 748,833
Operating Segments | Tommy Bahama
Operating groups
Net sales	880,233	724,305	419,817
Operating Segments | Lilly Pulitzer
Operating groups
Net sales	339,266	298,995	231,078
Operating Segments | Johnny Was
Operating groups
Net sales	72,591
Operating Segments | Emerging Brands
Operating groups
Net sales	116,484	90,053	58,200
Operating Segments | Lanier Apparel
Operating groups
Net sales		24,858	38,796
Corporate and Other
Operating groups
Net sales	2,954	3,868	942
Retail
Operating groups
Net sales	$ 552,696	$ 443,015	$ 202,071
Net sales (as a percent)	39.00%	39.00%	27.00%
Retail | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	46.00%	47.00%	37.00%
Retail | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	33.00%	34.00%	20.00%
Retail | Operating Segments | Johnny Was
Operating groups
Net sales (as a percent)	36.00%
Retail | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	6.00%	5.00%	3.00%
E-commerce
Operating groups
Net sales	$ 465,446	$ 369,300	$ 323,900
Net sales (as a percent)	33.00%	32.00%	43.00%
E-commerce | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	24.00%	25.00%	36.00%
E-commerce | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	51.00%	50.00%	64.00%
E-commerce | Operating Segments | Johnny Was
Operating groups
Net sales (as a percent)	42.00%
E-commerce | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	42.00%	39.00%	45.00%
Food & beverage
Operating groups
Net sales	$ 109,225	$ 96,244	$ 48,428
Net sales (as a percent)	8.00%	8.00%	6.00%
Food & beverage | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	13.00%	13.00%	11.00%
Wholesale
Operating groups
Net sales	$ 281,938	$ 231,536	$ 173,209
Net sales (as a percent)	20.00%	20.00%	23.00%
Wholesale | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	17.00%	15.00%	16.00%
Wholesale | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	16.00%	16.00%	16.00%
Wholesale | Operating Segments | Johnny Was
Operating groups
Net sales (as a percent)	22.00%
Wholesale | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	52.00%	56.00%	52.00%
Wholesale | Operating Segments | Lanier Apparel
Operating groups
Net sales (as a percent)		100.00%	100.00%
Wholesale | Corporate and Other
Operating groups
Net sales (as a percent)	43.00%	61.00%
Other
Operating groups
Net sales	$ 2,223	$ 1,984	$ 1,225
Other | Corporate and Other
Operating groups
Net sales (as a percent)	57.00%	39.00%	100.00%