Website Claiming to Grade Schools Fails on Technical and Philosophical Grounds

East Lansing, Mich. – In the fall of 2015, the Manhattan Institute for Policy Research launched a new website, SchoolGrades.org, which aimed to provide a means to compare how well America’s schools prepare students in core subjects. The website attempts to evaluate and assign letter grades to schools using reading and math test scores. Unfortunately, an academic review released today finds technical and logistical shortcomings associated with the website.

Jaime L. Del Razo, Annenberg Institute for School Reform and Brown University, reviewed the website SchoolGrades.org for the Think Twice think tank review project of the National Education Policy Center with funding from the Great Lakes Center for Education Research and Practice.

The website claims that the school grades found on the site allow parents to compare local schools against schools across the nation and in other countries using a four-step process.

Del Razo, in his review, notes that the process used to evaluate and assign grades is never fully explained. An investigation of the methods used found that the process apparently: (1) averages two state test scores; (2) “norms” the results to the NAEP exam; (3) makes an adjustment to this nationally normed measure using free and reduced lunch data to account at least partially for differences in socioeconomic status; and then (4) “norms” the results to the international PISA exam.

Ultimately, the review finds that the unsubstantiated norming chain is too tenuous and the results are overly extrapolated, which diminishes their value. Del Razo’s technical analysis also finds that the website fails to explain how:

  1. International scores are equated to a national standard created by the website;
  2. Letter grades are determined; and
  3. Free and reduced lunch counts were used to make socioeconomic adjustments.

In his conclusion, Del Razo indicates that the site fails on two grounds; technical and philosophical. He says, “the Manhattan Institute’s website fails to advance policy not only on the technical shortcomings of its efforts but most importantly, for not appreciating the purposes of education.”

Read the full review at: www.greatlakescenter.org.

Featured

  • How a Portable Sink Helped an Art Classroom Run More Smoothly

    Classroom design decisions can have outsized effects on instructional time and safety at schools juggling mismatched infrastructure, strict budgets, and crowded schedules — particularly in the arts. Between spilled paint and dirty brushes, art classes run smoother with a sink in the studio. But many schools don’t have a sink in every art classroom.

  • NWEA Report Recommends K–12 Natural Disaster Recovery Strategies

    The Northwest Evaluation Association (NWEA), a K–12 assessment and research organization, recently announced the release of a new playbook for schools and communities recovering from extreme weather events, according to a news release.

  • Chartwells Launches Campus Dining Evaluation Framework

    Contract food-service management provider Chartwells Higher Education recently announced the launch of BLUEPRINT, according to a news release. The evaluation framework was designed to provide a data-driven and customizable roadmap towards optimizing campus dining services and, by extension, the student experience.

  • Illinois State University Breaks Ground on College of Fine Arts Transformation

    Illinois State University in Normal, Ill., recently held a groundbreaking ceremony for the Wonsook Kim College of Fine Arts transformation project, according to university news. The series of new constructions and renovations will upgrade spaces in Centennial East, the Center for the Visual Arts, and the Center for the Performing Arts, as well as replace the existing Centennial West facility with a new Commons Building.