Exhibit 23.1

Consent of Independent Registered Public Accounting Firm

We consent to the incorporation by reference in the following Registration Statements:

(1) Registration Statement (Form S-8 No. 333-75378) pertaining to the 2001 Stock Option Plan for Directors and 2001 Stock Purchase Plan for Officers and Employees

(2) Registration Statement (Form S-8 No. 333-132175) pertaining to the 2005 Stock Incentive Plan of Calavo Growers, Inc.

of our reports dated January 17, 2012, with respect to the consolidated financial statements and schedule of Calavo Growers, Inc., and the effectiveness of internal control over financial reporting of Calavo Growers, Inc., included in this Annual Report (Form 10-K) for the year ended October 31, 2011.

/s/ Ernst & Young LLP

Los Angeles, California

January 17, 2012