Exhibit 23.1

CONSENT OF INDEPENDENT REGISTERED PUBLIC ACCOUNTING FIRM

We consent to the incorporation by reference in Registration Statements No. 333-81741, No. 333-114933 and No. 333-133846 on Forms S-8 of our reports dated April 16, 2007, relating to the consolidated financial statements of Perry Ellis International, Inc. and subsidiaries and management’s report on the effectiveness of internal control over financial reporting, appearing in this Annual Report on Form 10-K of Perry Ellis International, Inc. for the year ended January 31, 2007.

/s/ Deloitte & Touche LLP

Miami, Florida

April 16, 2007