Shareholders' Equity - Narrative (Details)	12 Months Ended
	Jan. 01, 2023 USD ($) $ / shares shares	Jan. 02, 2022 USD ($) $ / shares shares	Jan. 03, 2021 USD ($) $ / shares shares	May 17, 2022 USD ($)	May 22, 2020 shares	May 31, 2015 shares
Shareholders' Equity [Line Items]
Common stock, shares authorized (in shares) | shares	120,000,000	120,000,000
Common stock, par value (in dollars per share) | $ / shares	$ 0.10	$ 0.10
Common stock, cash dividends declared (in dollars per share) | $ / shares	0.04	0.04	$ 0.095
Common stock, cash dividends paid (in dollars per share) | $ / shares	$ 0.04	$ 0.04	$ 0.095
Number of shares authorized for issuance or transfer (in shares) | shares					3,700,000	5,161,020
Number of authorized stock reduced by issuance of other than stock option award						1.33
Stock based compensation rate at which stock options exercisable (percentage)	100.00%
Stock compensation amortization expense (benefit)	$ 8,527,000	$ 5,467,000	$ (502,000)
Outstanding at end of year (in shares) | shares	0	0
Exercisable at end of year (in shares) | shares	0	0
Compensation expense, tax benefit	$ 800,000	$ 700,000	600,000
Stock Options
Shareholders' Equity [Line Items]
Stock compensation amortization expense (benefit)	$ 0	0	0
Stock Options | Minimum
Shareholders' Equity [Line Items]
Vesting period (in years)	1 year
Expiration period (in years)	3 years
Stock Options | Maximum
Shareholders' Equity [Line Items]
Vesting period (in years)	5 years
Expiration period (in years)	10 years
Restricted Stock
Shareholders' Equity [Line Items]
Stock compensation amortization expense (benefit)	$ 5,300,000	$ 3,800,000	$ 1,300,000
Stock awards granted (in shares) | shares	500,800	428,400	308,100
Stock awards granted, weighted average grant date fair value (in dollars per share) | $ / shares	$ 13.08	$ 14.26	$ 13.08
Unrecognized compensation expense related to unvested stock awards	$ 5,800,000
Restricted Stock | Minimum
Shareholders' Equity [Line Items]
Vesting period (in years)	1 year
Restricted Stock | Maximum
Shareholders' Equity [Line Items]
Vesting period (in years)	3 years
Performance Shares
Shareholders' Equity [Line Items]
Stock compensation amortization expense (benefit)	$ 3,200,000	$ 1,700,000	$ (1,800,000)
Stock awards granted (in shares) | shares	366,900
Stock awards granted, weighted average grant date fair value (in dollars per share) | $ / shares	$ 13.02
Unrecognized compensation expense related to unvested stock awards	$ 7,600,000
Number of shares that may be issued in settlement of the performance shares to the award recipient, upper limit (percentage)	200.00%
Performance Shares | Minimum
Shareholders' Equity [Line Items]
Vesting period (in years)	1 year
Performance Shares | Maximum
Shareholders' Equity [Line Items]
Vesting period (in years)	3 years
Common Stock
Shareholders' Equity [Line Items]
Share repurchase program, authorized amount				$ 100,000,000
Share repurchases (in shares) | shares	1,383,682
Share repurchases, weighted average price (in dollars per share) | $ / shares	$ 12.41