Exhibit 23.1

Consent of Independent Registered Public Accounting Firm

We consent to the incorporation by reference in this Registration Statement on Form S-8 of Impac Mortgage Holdings, Inc. (the “Company”) of our reports dated March 13, 2020, relating to the Company’s consolidated financial statements and the effectiveness of the Company’s internal control over financial reporting, both appearing in the Company’s Annual Report on Form 10-K as of and for the year ended December 31, 2019.

/s/ Squar Milner LLP

Irvine, California

July 13, 2020