Summary of Significant Accounting Policies - Additional Information (Details)		3 Months Ended		12 Months Ended
	Feb. 03, 2019 USD ($)	Nov. 02, 2019 USD ($)	Feb. 02, 2019 USD ($)	Feb. 01, 2020 USD ($) Store Segment RenewalOption shares	Feb. 02, 2019 USD ($) shares	Feb. 03, 2018 USD ($) shares
Accounting Policies [Line Items]
Number of reportable segments | Segment				1
Number of operating segments | Segment				2
Corporate restructuring and CEO transition costs					$ 4,300,000
Direct response advertising costs, amortization period				1 year
Direct response costs deferred			$ 0	$ 0	$ 0
Shares excluded from computation of basic and diluted earnings per share | shares				408,000	497,000	134,000
Stock compensation expense				$ 1,922,000	$ 2,004,000	$ 1,636,000
Total grant-date fair value of options vested				$ 3,000,000	2,000,000	1,800,000
Grants in period | shares				0
Impairment charge				$ 900,000	4,600,000	4,100,000
Impairment of right-of-use asset	$ 3,800			700,000
Right-of-use assets	214,100,000			186,413,000
Lease liabilities	254,500,000			$ 223,227,000
Sale-leaseback transaction, lease term				20 years
Amortization of deferred gain on sale-leaseback	1,500,000				$ 1,465,000	1,465,000
Sale-leaseback transaction, deferred gain	10,300,000			$ 10,300,000
Cumulative-effect adjustment to opening balance of retained earnings	5,300			$ 5,300
Write-off of initial direct costs	$ 1,200
Operating lease, option to extend				Renewal options are not included in the lease term for automobile and equipment leases because they are not considered reasonably certain of being exercised at lease commencement. Renewal options were not considered for the Company’s corporate headquarters and distribution center lease, which was entered into in 2006 and was for an initial 20-year term.
Store
Accounting Policies [Line Items]
Operating lease, option to extend				The Company’s store leases typically contain options that permit renewals for additional periods of up to five years each. In general, for store leases with an initial term of 10 years or more, the options to extend are not considered reasonably certain at lease commencement. For stores leases with an initial term of 5 years, the Company evaluates each lease independently and, only when the Company considers it reasonably certain that it will exercise an option to extend, will the associated payment of that option be included in the measurement of the right-of-use asset and lease liability
Operating lease renewal term				5 years
Corporate Headquarter
Accounting Policies [Line Items]
Operating lease renewal term				5 years
Operating lease initial term				20 years
Number of renewal options | RenewalOption				6
Unvested time-based restricted stock
Accounting Policies [Line Items]
Dilutive shares | shares					30,000
Performance Stock Units
Accounting Policies [Line Items]
Shares excluded from computation of basic and diluted earnings per share | shares				720,000,000
Deferred Stock
Accounting Policies [Line Items]
Shares excluded from computation of basic and diluted earnings per share | shares				295,604,000	204,040,000
Time-Vested Awards
Accounting Policies [Line Items]
Unrecognized stock compensation cost				$ 2,600,000
Unrecognized stock compensation cost weighted average recognition period				29 months
Rochester Clothing Store Located in London
Accounting Policies [Line Items]
Accumulated foreign currency translation adjustment, recognized		$ 800,000
Selling, General and Administrative Expenses
Accounting Policies [Line Items]
Advertising expenses				$ 22,900,000	$ 24,400,000	29,500,000
Casual Male Trademark
Accounting Policies [Line Items]
Amortization expense of intangibles					300,000	400,000
Technology Projects
Accounting Policies [Line Items]
Impairment charge						$ 1,900,000
Domain Name (dxl.com)
Accounting Policies [Line Items]
Rights purchase price					1,000,000
Transaction costs incurred to purchase rights					150,000
Rochester Trademark
Accounting Policies [Line Items]
Impairment charge			$ 1,500,000		$ 1,500,000
Minimum
Accounting Policies [Line Items]
Credit card and debit card receivables from banks settlement period				2 days
Minimum | Store
Accounting Policies [Line Items]
Operating lease initial term				5 years
Maximum
Accounting Policies [Line Items]
Credit card and debit card receivables from banks settlement period				4 days
Maximum | Store
Accounting Policies [Line Items]
Operating lease renewal term				5 years
Operating lease initial term				10 years
Canada
Accounting Policies [Line Items]
Number of stores | Store				2
DXL Stores | UNITED STATES
Accounting Policies [Line Items]
Number of stores | Store				228
Casual Male XL Retail and Outlet Stores | UNITED STATES
Accounting Policies [Line Items]
Number of stores | Store				50
Casual Male XL outlets
Accounting Policies [Line Items]
Number of stores | Store				28
DXL Outlets | UNITED STATES
Accounting Policies [Line Items]
Number of stores | Store				17
DXL Outlets | Canada
Accounting Policies [Line Items]
Number of stores | Store				2