Summary of Significant Accounting Policies - Other Comprehensive Income (loss) and Reclassifications from AOCI (Parenthetical) (Details) - USD ($)	12 Months Ended
	Feb. 03, 2024	Jan. 28, 2023	Jan. 29, 2022	Jan. 30, 2021
Accumulated Other Comprehensive Income (Loss) [Line Items]
Selling, general and administrative	$ 196,529,000	$ 198,790,000	$ 172,962,000
Income tax provision (benefit)	10,537,000	(30,788,000)	917,000
Supplemental Executive Retirement Plan
Accumulated Other Comprehensive Income (Loss) [Line Items]
Unrealized loss in accumulated other comprehensive loss	(57,000)
Casual Male Corp. Retirement Plan
Accumulated Other Comprehensive Income (Loss) [Line Items]
Unrealized loss in accumulated other comprehensive loss	5,600,000
Casual Male Corp. Retirement Plan | Supplemental Executive Retirement Plan
Accumulated Other Comprehensive Income (Loss) [Line Items]
Unrealized loss in accumulated other comprehensive loss	(31,000)
Pension Plans | Supplemental Executive Retirement Plan
Accumulated Other Comprehensive Income (Loss) [Line Items]
Unrealized loss in accumulated other comprehensive loss	5,700,000
Unrealized loss in accumulated other comprehensive loss, tax effect	600,000
Reclassification out of Accumulated Other Comprehensive Income | Pension Plans
Accumulated Other Comprehensive Income (Loss) [Line Items]
Selling, general and administrative	102,000
Income recognized due to change in amortization		39,000	41,000
Income tax provision (benefit)	$ 27,000	$ 9,000	$ 0	$ 0