Exhibit 23

Consent of Independent Registered Public Accounting Firm

We consent to the incorporation by reference in this Annual Report to Shareholders (Form 10-K) of Summit Financial Group, Inc. and subsidiaries of our reports, dated February 28, 2011, with respect to our audits of the consolidated financial statements of Summit Financial Group, Inc. and subsidiaries included in the 2010 Annual Report to Shareholders for the year ended December 31, 2010.

We also consent to the incorporation by reference in the Registration Statements (Form S-8, Nos. 333-99291 and 333-99291) pertaining to the 1998 and 2009 Officer Stock Option Plan of Summit Financial Group, Inc. and subsidiaries of our reports, dated February 28, 2011, with respect to our audits of the consolidated financial statements of Summit Financial Group, Inc. and subsidiaries included in the 2010 Annual Report to Shareholders for the year ended December 31, 2010.

/s/    ARNETT & FOSTER, P.L.L.C.

Charleston, West Virginia

February 28, 2011