Summary of Significant Accounting Policies - Additional Information (Details)		12 Months Ended
		Jan. 30, 2016 USD ($) Store Segment shares	Jan. 31, 2015 USD ($) shares	Feb. 01, 2014 USD ($) shares
Accounting Policies [Line Items]
Amortization of deferred debt issuance costs		$ 279,000	$ 192,000	$ 136,000
Number of reportable segments | Segment		1
Number of operating segments | Segment		2
Amortization expense of intangibles		$ 639,000	1,100,000	1,900,000
Direct response costs deferred		$ 0	0
Shares of restricted stock outstanding | shares		1,320,143
Stock compensation expense		$ 2,195,000	2,996,000	1,893,000
Total compensation expenses after tax				0
Total grant-date fair value of options vested		1,000,000	1,200,000	100,000
Impairment charges			300,000	$ 1,500,000
Gift card liability, net of breakage		$ 1,800,000	$ 1,400,000
Unvested time-based restricted stock
Accounting Policies [Line Items]
Dilutive shares | shares		379,061
Unvested performance-based restricted stock
Accounting Policies [Line Items]
Securities excluded from computation of earnings per share, respective performance targets not yet achieved, amount | shares		941,082
Performance-Based Stock Options and Restricted Stock Awards
Accounting Policies [Line Items]
Securities excluded from computation of earnings per share, respective performance targets not yet achieved, amount | shares		1,181,168
Unrecognized stock compensation cost		$ 7,200,000
Deferred Stock
Accounting Policies [Line Items]
Shares excluded from computation of basic earnings per share | shares			31,587
Outstanding shares | shares				31,587
Time-Vested Stock Options and Time-Based Restricted Stock Awards
Accounting Policies [Line Items]
Unrecognized stock compensation cost		$ 900,000
Unrecognized stock compensation cost weighted average recognition period		14 months
Selling, General and Administrative Expenses
Accounting Policies [Line Items]
Advertising expenses		$ 23,600,000	$ 26,000,000	$ 27,100,000
Other Intangible Assets
Accounting Policies [Line Items]
Intangible assets, estimated useful life		16 years
Weighted average amortization period remaining for other intangibles		2 years 3 months 18 days
Amortization expense of intangibles		$ 100,000
Customer Lists
Accounting Policies [Line Items]
Gross carrying amount of intangibles		7,700,000	7,700,000
Casual Male Trademark
Accounting Policies [Line Items]
Accumulated amortization of intangibles		6,500,000	$ 5,900,000
Amortization expense of intangibles	[1]	539,000
Rochester Trademark
Accounting Policies [Line Items]
Indefinite-lived intangible asset, carrying value		$ 1,500,000
Minimum
Accounting Policies [Line Items]
Credit card and debit card receivables from banks settlement period		2 days
Maximum
Accounting Policies [Line Items]
Credit card and debit card receivables from banks settlement period		4 days
Direct response advertising costs, amortization period		1 year
DXL Stores | UNITED STATES
Accounting Policies [Line Items]
Number of stores | Store		166
Casual Male XL Retail and Outlet Stores
Accounting Policies [Line Items]
Intangible assets, amortization period		2018
Casual Male XL Retail and Outlet Stores | UNITED STATES
Accounting Policies [Line Items]
Number of stores | Store		125
Casual Male XL outlets
Accounting Policies [Line Items]
Number of stores | Store		40
DXL Outlets
Accounting Policies [Line Items]
Number of stores | Store		9
Rochester Clothing Stores | UNITED STATES
Accounting Policies [Line Items]
Number of stores | Store		5
Rochester Clothing Stores | UNITED KINGDOM
Accounting Policies [Line Items]
Number of stores | Store		1

[1] The “Casual Male” trademark has been accounted for as a finite-lived asset since the beginning of fiscal 2012.