By on December 17, 2007

usnews-car.jpgU.S.News & World Report believes in editorial transparency. So they've published the methodology they use to rate virtually every new car sold in America. As you'd expect from such a soberly-titled title, the recommendations are based on "hard data and analysis." First, they convert reviews by unnamed "respected auto critics" into a numeric score, using an undisclosed process. Then, they add information "such as safety and reliability data" that's scored and weighted according to an unspecified formula. After that, they combine all the scores and calculate them using a process "based on [unrevealed factors that] consumers say matters to them most in a car." The result? An overall score that allows their editors to compare cars, "ranking them against each other." They do admit that sometimes "the overall score is higher or lower than the component scores we display" because they also consider the "author's level of recommendation or overall impression about the car." OK, to sum up, they arbitrarily assign scores based on their assessment of someone else's assessment, add in their ranking of someone else's safety and reliability data, and out pops a number that may or may not be the final score, based on their author's arbitrary opinion of the vehicle. And that's the truth. [thanks to starlightmica for the link]

Get the latest TTAC e-Newsletter!

9 Comments on “U.S. News Clarifies Their Auto Ranking Process. Or Not....”


  • avatar
    shaker

    I guess that the more data that you “gather” to back up an ultimately nebulous rating, the better.

  • avatar
    detroit1701

    “based on [unrevealed factors that]”

    Hah. US News also does that with their grad school rankings as well. Although it publishes some numbers, it relies upon mysterious “other” factors in making determinations. Which is all well and good when the ranking of your law school plays a large role in what types of opportunities will be open to you throughout your career.

  • avatar
    dean

    The process is no worse than TTAC’s own Ten Worst Awards, wherein a bunch of people who have never driven a vehicle nominate and vote for its inclusion based on little more than hearsay and a personal dislike for the looks/brand.

    The big difference, however, is that the TTAC Ten Worst Awards make no pretense of being sober, scientific or objective. As such, the methodology is excusable and the exercise is fun. As it happens, the results are probably fairly representative too. (Witness the number of TWA winners at or near the bottom of Consumer Reports rankings).

  • avatar
    Virtual Insanity

    So they rate cars like I guess on standardized tests?

  • avatar
    Chaser

    dean> Exactly. And, like the TTAC award, the final call is an arbitrary opinion of the writers. That’s why I consider TTAC’s 10 worst and 10 best awards as purely entertainment and not to be taken seriously.

  • avatar
    ajla

    How hard is it really to make a ranking of automobiles? You don’t need any set formulas at all.

    Just follow the common method that all automotive magazines use to make a “Best of” list:

    1. include at least 1 BMW for “driving dynamics”
    2. include at least 1 American car as a “suprise quality hit that shows corporate culture is changing”
    3. Prius
    4. 911/Cayman/Boxster
    5. Corvette
    6. include an Infiniti/Acura as the “smart alternative to the Germans”
    7. High MPG non-hybrid.
    8. Miata or the MazdaSpeed3

    Find a list that doesn’t have this stuff included.

  • avatar

    US News specializes in catering to readers’ desire for expert opinions on practical stuff (news you can use, in their parlance). Even people who aren’t in the market scan this stuff avidly to see if what they have is “the best.”

    I’m going to be coming out with my list of “best bridges to buy for $200.” I’ve already determined that Boston’s (my town) Leonard Zakim Bunker Hill Bridge will be the winner, followed by the Brooklyn Bridge, but please, as a courtesy to a fellow car enthusiast, don’t tell the people at US News about this.

  • avatar
    phil

    Frank, hilarious piece, thanks. At least they didn’t add “statistical analysis” to their assessments!

  • avatar
    yankinwaoz

    Isn’t that kinda of how Google ranks web pages?

    Well, at least it isn’t as bad as most magazines who give top rankings to their largest advertisers.


Back to TopLeave a Reply

You must be logged in to post a comment.

Subscribe without commenting

Recent Comments

New Car Research

Get a Free Dealer Quote

Staff

  • Authors

  • Brendan McAleer, Canada
  • Marcelo De Vasconcellos, Brazil
  • Matthias Gasnier, Australia
  • W. Christian 'Mental' Ward, Abu Dhabi
  • Mark Stevenson, Canada
  • Faisal Ali Khan, India