Health Affairs Analysis: Hospital Ratings Systems Generate Confusion Instead of Clarity | Healthcare Informatics Magazine | Health IT | Information Technology Skip to content Skip to navigation

Health Affairs Analysis: Hospital Ratings Systems Generate Confusion Instead of Clarity

March 14, 2015
by Mark Hagland
| Reprints
A team of healthcare researchers finds that diversity of methodologies among four major hospital care ratings systems is sowing confusion

In an analysis published in the March issue of Health Affairs, a team of healthcare researchers has found that hospital quality ratings systems have created more confusion than clarity around quality measures and outcomes.

The article, “National Hospital Ratings Systems Share Few Common Scores and May Generate Confusion Instead of Clarity,” was written by J. Matthew Austin, Ashish K. Jha, Patrick S. Romano, Sara J. Singer, Timothy, J. Vogus, Robert M. Wachter, and Peter J. Pronovost. The authors write in their abstract, “Attempts to assess the quality and safety of hospitals have proliferated, including a growing number of consumer-directed hospital rating systems… To better understand differences in hospital ratings, we compared four national rating systems”—those of U.S. News (is annual Best Hospitals list), HealthGrades, the Leapfrog Group, and Consumer Reports—“and examined the overlap among rating systems and how hospital characteristics corresponded with performance on each.”

Interestingly, the researchers found, “No hospital was rated as a high performer by all four national rating systems. Only 10 percent of the 844 hospitals rated as a high performer by one rating system were rated as a high performer by any of the other rating systems. The lack of agreement among the national hospital rating systems,” the researchers concluded, “is likely explained by the fact that each system uses its own rating methods, has a different focus to its ratings, and stresses different measures of performance.”

In sum, “The four rating systems that we evaluated,” the authors noted, “varied in their foci, measures, methods, and transparency—characteristics that have the potential to confuse patients, providers, and purchasers. Only a very small number of hospitals were found to be either high or low performers on multiple ratings.” In the end, “Although the variety and differences aong hospital rating systems may be beneficial to patients, providers, and purchasers, these stakeholders would benefit if rating organizations could agree on standards for transparently reporting key features of their ratings. Full transparency in how ratings are constructed is especially important to patients, hospitals and researchers,” they wrote. “Being able to replicate ratings can help hospitals understand where to focus their improvement efforts, researchers can assess the antecedents and consequences of a hospital’s rating, and consumers can better grasp the meaning of ‘best’ or ‘safest’ and make more informed decisions about their care.”


Get the latest information on Health IT and attend other valuable sessions at this two-day Summit providing healthcare leaders with educational content, insightful debate and dialogue on the future of healthcare and technology.

Learn More



Hospital Rating System


Healthcare Execs Anticipate High Cost Returns from Predictive Analytics Use

Healthcare executives are dedicating budget to predictive analytics, and are forecasting significant cost savings in return, according to new research from the Illinois-based Society of Actuaries.

Adam Boehler Tapped by Azar to Serve as Senior Value-Based Care Advisor

Adam Boehler, currently director of CMMI, has also been named the senior advisor for value-based transformation and innovation, HHS Secretary Alex Azar announced.

Vivli Launches Clinical Research Data-Sharing Platform

On July 19 a new global data-sharing and analytics platform called Vivli was unveiled. The nonprofit group’s mission is to promote, coordinate and facilitate scientific sharing and reuse of clinical research data.

Survey: More Effective IT Needed to Improve Patient Safety

In a Health Catalyst survey, physicians, nurses and healthcare executives said ineffective information technology, and the lack of real-time warnings for possible harm events, are key obstacles to achieving their organizations' patient safety goals.

Physicians Still Reluctant to Embrace Virtual Tech, Survey Finds

While consumers and physicians agree that virtual healthcare holds great promise for transforming care delivery, physicians still remain reluctant to embrace the technologies, according to a new Deloitte Center for Health Solutions survey.

Geisinger, AstraZeneca Partner on Asthma App Suite

Geisinger has partnered with pharmaceutical company AstraZeneca to create a suite of products that integrate into the electronic health record and engage asthma patients and their providers in co-managing the disease.