Operating Groups (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended								12 Months Ended
	Feb. 01, 2014	Nov. 02, 2013	Aug. 03, 2013	May 04, 2013	Feb. 02, 2013	Oct. 27, 2012	Jul. 28, 2012	Apr. 28, 2012	Feb. 01, 2014 operatinggroup	Feb. 02, 2013	Jan. 28, 2012
Segment Reporting [Abstract]
Number of operating groups									4
Operating groups
Net sales	$ 250,364	$ 197,506	$ 235,024	$ 234,203	$ 236,246	$ 181,414	$ 206,929	$ 230,953	$ 917,097	$ 855,542	$ 758,913
Depreciation and Amortization of Intangible Assets									33,902	26,335	27,154
Operating Income (Loss)	26,346	4,551	27,712	26,061	9,945	5,920	20,318	32,788	84,670	68,971	68,807
Interest expense, net									4,169	8,939	16,266
Loss on repurchase of senior notes							9,100		0	9,143	9,017
Earnings from continuing operations before income taxes									80,501	50,889	43,524
Purchases of Property and Equipment									43,372	60,702	35,310
Total Assets	627,305				556,070				627,305	556,070
Tommy Bahama
Operating groups
Net sales									584,941	528,639	452,156
Depreciation and Amortization of Intangible Assets									24,806	18,551	19,460
Operating Income (Loss)									72,207	69,454	64,171
Purchases of Property and Equipment									30,810	46,392	24,686
Total Assets	408,599				359,462				408,599	359,462
Tommy Bahama | Minimum
Operating groups
Age of target consumers	35 years								35 years
Lilly Pulitzer
Operating groups
Net sales									137,943	122,592	94,495
Depreciation and Amortization of Intangible Assets									3,215	2,402	2,002
Operating Income (Loss)									25,951	20,267	14,278
Purchases of Property and Equipment									10,343	4,576	3,228
Total Assets	101,704				90,873				101,704	90,873
Lanier Clothes
Operating groups
Net sales									109,530	107,272	108,771
Depreciation and Amortization of Intangible Assets									347	421	427
Operating Income (Loss)									10,828	10,840	12,862
Purchases of Property and Equipment									30	593	85
Total Assets	39,989				28,455				39,989	28,455
Ben Sherman
Operating groups
Net sales									67,218	81,922	91,435
Depreciation and Amortization of Intangible Assets									3,154	2,889	2,638
Operating Income (Loss)									(13,131)	(10,898)	(2,535)
Purchases of Property and Equipment									1,137	3,997	4,220
Total Assets	79,299				74,055				79,299	74,055
Ben Sherman | Minimum
Operating groups
Age of target consumers	25 years								25 years
Ben Sherman | Maximum
Operating groups
Age of target consumers	40 years								40 years
Corporate and Other
Operating groups
Net sales									17,465	15,117	12,056
Depreciation and Amortization of Intangible Assets									2,380	2,072	2,627
Operating Income (Loss)									(11,185)	(20,692)	(19,969)
Purchases of Property and Equipment									1,052	5,144	3,091
Total Assets	$ (2,286)				$ 3,225				$ (2,286)	$ 3,225