Operating Groups - Financial information (Details) - USD ($) $ in Thousands	12 Months Ended
	Jan. 28, 2023	Jan. 29, 2022	Jan. 30, 2021
Operating groups
Net sales	$ 1,411,528	$ 1,142,079	$ 748,833
Depreciation and amortization	49,035	41,598	59,914
Operating income (loss)	218,774	165,503	(123,849)
Interest expense, net	3,049	944	2,028
Earnings (loss) before income taxes	215,725	164,559	(125,877)
Impairment of goodwill and intangible assets			60,452
Gain on sale of investment in unconsolidated entity		11,586
Corporate and Other
Operating groups
Net sales	2,954	3,868	942
Depreciation and amortization	663	685	837
Operating income (loss)	(35,143)	(31,368)	(8,863)
LIFO accounting charge (credit)	3,000	16,000	9,000
Transaction expenses and integration costs	3,000
Gain on sale of investment in unconsolidated entity		12,000
Tommy Bahama | Operating Segments
Operating groups
Net sales	880,233	724,305	419,817
Depreciation and amortization	26,807	27,830	46,698
Operating income (loss)	172,761	111,733	(53,310)
Lilly Pulitzer | Operating Segments
Operating groups
Net sales	339,266	298,995	231,078
Depreciation and amortization	12,784	11,678	9,965
Operating income (loss)	67,098	63,601	27,702
Johnny Was | Operating Segments
Operating groups
Net sales	72,591
Depreciation and amortization	7,199
Operating income (loss)	(1,544)
Emerging Brands | Southern Tide brand
Operating groups
Impairment of goodwill and intangible assets	0	0	60,000
Emerging Brands | Operating Segments
Operating groups
Net sales	116,484	90,053	58,200
Depreciation and amortization	1,582	1,298	1,175
Operating income (loss)	$ 15,602	16,649	(62,724)
Lanier Apparel | Operating Segments
Operating groups
Net sales		24,858	38,796
Depreciation and amortization		107	1,239
Operating income (loss)		$ 4,888	$ (26,654)