Exhibit 23

Consent of Independent Registered Public Accounting Firm

The Board of Directors

Arbitron Inc.:

We consent to the incorporation by reference in the registration statement (Nos. 333-58143, 333-89565, 333-56296, 333-85492,
333-124663, 333-149441, 333-155577, 333-155578, 333-170318, 333-170319) on Forms S-8 of Arbitron Inc. of our reports dated February 25, 2013, with respect to the consolidated balance sheets of Arbitron Inc. as of December 31, 2012 and 2011, and the related consolidated statements of income, comprehensive income, stockholders’ equity, and cash flows for each of the years in the three-year period ended December 31, 2012, and the related financial statement schedule and the effectiveness of internal control over financial reporting, which reports appear in the December 31, 2012 annual report on Form 10-K of Arbitron Inc.

/s/ KPMG LLP

Baltimore, Maryland

February 25, 2013