Reportable Segment Information (Business Segment Information) (Details) $ in Thousands	12 Months Ended
	Jan. 02, 2021 USD ($) segment	Dec. 28, 2019 USD ($)	Dec. 29, 2018 USD ($)
Segment Reporting Information [Line Items]
Number of reportable segments | segment	2
Net sales	$ 1,955,363	$ 2,246,947	$ 2,257,895
Operating income	61,375	151,342	128,173
Interest expense, net	6,990	8,628	9,448
Total	54,385	142,714	118,725
Depreciation and Amortization Expense:	77,683	77,427	74,788
Capital Expenditures (including capitalized software):	41,802	66,885	63,696
Identifiable Assets:	1,418,032	1,452,512	1,401,844
Workplace furnishings
Segment Reporting Information [Line Items]
Net sales	1,365,711	1,697,186	1,706,092
Residential building products
Segment Reporting Information [Line Items]
Net sales	589,652	549,761	551,803
Operating | Workplace furnishings
Segment Reporting Information [Line Items]
Net sales	1,365,711	1,697,186	1,706,092
Operating profit	(4,972)	103,894	75,965
Depreciation and Amortization Expense:	44,615	44,887	44,303
Capital Expenditures (including capitalized software):	24,188	41,137	47,860
Identifiable Assets:	762,780	874,913	797,574
Operating | Residential building products
Segment Reporting Information [Line Items]
Net sales	589,652	549,761	551,803
Operating profit	109,321	94,329	91,367
Depreciation and Amortization Expense:	9,386	8,884	8,171
Capital Expenditures (including capitalized software):	8,213	12,225	8,854
Identifiable Assets:	381,550	364,653	352,060
General corporate
Segment Reporting Information [Line Items]
General corporate	(42,974)	(46,881)	(39,159)
Depreciation and Amortization Expense:	23,682	23,656	22,314
Capital Expenditures (including capitalized software):	9,401	13,523	6,982
Identifiable Assets:	$ 273,702	$ 212,946	$ 252,210