Goodwill, Other Intangible Assets and Long-Lived Assets - Rollforward of Intangible Assets (Details) - USD ($) $ in Thousands	12 Months Ended
	Mar. 31, 2017	Mar. 31, 2016
Finite-lived Intangible Assets [Roll Forward]
Beginning balance	$ 56,807
Ending balance	61,807	$ 56,807
Tradenames and trademarks
Finite-lived Intangible Assets [Roll Forward]
Beginning balance	15,553	12,953
Purchase of customer lists	0
Ending balance	19,953	15,553
Customer relationships
Finite-lived Intangible Assets [Roll Forward]
Beginning balance	39,157	29,957
Purchase of customer lists	100
Ending balance	39,757	39,157
Blumenthal Lansing Company, LLC | Tradenames and trademarks
Finite-lived Intangible Assets [Roll Forward]
Acquisition		2,600
Blumenthal Lansing Company, LLC | Customer relationships
Finite-lived Intangible Assets [Roll Forward]
Acquisition		$ 9,200
The McCall Pattern Company | Tradenames and trademarks
Finite-lived Intangible Assets [Roll Forward]
Acquisition	4,400
The McCall Pattern Company | Customer relationships
Finite-lived Intangible Assets [Roll Forward]
Acquisition	0
Lawrence Schiff Silk Mills, Inc. | Tradenames and trademarks
Finite-lived Intangible Assets [Roll Forward]
Acquisition	0
Lawrence Schiff Silk Mills, Inc. | Customer relationships
Finite-lived Intangible Assets [Roll Forward]
Acquisition	$ 500