Research of mHealth Apps Reveals Significant Gaps in Quality | Healthcare Informatics Magazine | Health IT | Information Technology Skip to content Skip to navigation

Research of mHealth Apps Reveals Significant Gaps in Quality

December 7, 2016
by Rajiv Leventhal
| Reprints

An evaluation of 137 patient-facing mobile health (mHealth) apps revealed subpar findings, including that few apps address the needs of the patients who could benefit the most, according to research in December’s issue of Health Affairs.

Researchers from University of Michigan Medical School, the Department of Medicine at Brigham and Women’s Hospital, and elsewhere noted that key stakeholders, including medical professional societies, insurers, and policy makers, have largely avoided formally recommending apps, which forces patients to obtain recommendations from other sources. As such, the researchers evaluated apps that were intended for use by patients to manage their health, that were highly rated by consumers and recommended by experts, and that targeted high-need, high-cost populations.

They found that there is a wide variety of apps in the marketplace but that “few apps address the needs of the patients who could benefit the most. “We also found that consumers’ ratings were poor indications of apps’ clinical utility or usability and that most apps did not respond appropriately when a user entered potentially dangerous health information. Going forward, data privacy and security will continue to be major concerns in the dissemination of mHealth apps,” the researchers stated.

To identify apps that target high-need, high-cost populations, the researchers conducted a systematic search for mHealth apps in the Apple iTunes (iOS) and Google Play (Android) app stores. They also systematically searched for app suggestions on medical professional society websites. They further solicited recommendations for apps through telephone interviews with experts in mobile technology, vulnerable populations, and patient advocacy, and then identified additional health apps based on personal experience. Each selected app was assigned for review to both a clinician and a non-clinician. Apps available for both iOS and Android were reviewed on both platforms.

The app analysis focused on nine variables: the target population for each app; each app’s types of functionality related to patient engagement; app store rating; clinical utility; usability; the app’s reactivity to information that could indicate health danger; the presence of a privacy policy; the mechanism of data sharing; and the cost model. Many apps were designed to serve multiple high-need, high-cost populations, and eleven of them were deemed general enough to be useful across all such populations.

Of the most noteworthy findings, the researchers found that of the 121 apps that allow patients to record health-oriented information, only 28 (23 percent) responded appropriately when information was entered that indicated a health danger, such as suicidal mood or ideation. For only three target populations—people with a history of stroke, those with asthma or chronic obstructive pulmonary disorder, and the elderly—did at least 50 percent of the apps react appropriately to relevant health information.

What’s more, nearly all of the apps for each of the high-need, high-cost populations included some functionality to track or record and to display or summarize user-entered information, and many apps provided educational information and reminders or alerts All of these functionalities are likely to be useful to patients with relatively low levels of engagement. In contrast, very few apps focused on providing guidance based on user-entered information or support through social networks, or on rewarding behavior change—functionalities likely to be useful to relatively more engaged patients, the research concluded.

In terms of secure data sharing, 15 apps (11 percent) enabled data sharing with Apple’s HealthKit, 14 apps (10 percent) enabled users to create a separate log-in for recipients of shared information, five apps (4 percent) enabled data sharing with Google Fit, and 1 app (less than 1 percent) enabled users to submit information directly to their electronic health record (EHR). The absence of secure data exchange is a concern because only 88 (64 percent) of the reviewed apps had a privacy policy, the researchers concluded.

Based on their findings, the researchers offered the following recommendations to organizations interested in assessing the value of apps for specific patient populations:

  • Involve clinicians and patients in the review process
  • Tailor recommendations based on engagement level
  • Require crisis management standards
  • Require secure data exchange

According to the researchers, the results suggest that the marketplace of mHealth apps targeting high-need, high-cost populations is maturing and is diverse enough that medical professional societies and patient advocacy groups should give serious thought to how apps may be used to benefit specific patients. Still, they said that there are many gaps in the apps and substantial room for improving them. “Consumer app ratings represent a good place to start for identifying high-quality apps, but such ratings should be supported by clinician and patient input on clinical utility and usability. While the app industry needs to do further work to meet basic safety and privacy standards, a subset of apps already conform to these standards. Policy makers need to consider how to encourage app developers to build apps that respond appropriately to dangerous information entered by users,” they concluded. 

Get the latest information on Health IT and attend other valuable sessions at this two-day Summit providing healthcare leaders with educational content, insightful debate and dialogue on the future of healthcare and technology.

Learn More



NCQA Approved by Government as an ONC-Authorized Testing Lab

The National Committee for Quality Assurance (NCQA) has announced that its eMeasure testing laboratory is now approved by the Office of the National Coordinator for Health Information Technology (ONC).

Survey: Infrastructure, Interoperability Key Barriers to Global HIT Development

A new survey report from Black Book Research on global healthcare IT adoption and records systems connectivity finds nations in various phases of regional electronic health record (EHR) adoption. The survey results also reveal rapidly advancing opportunities for U.S.-based and local technology vendors.

Penn Medicine Opens Up Telehealth Hub

Philadelphia-based Penn Medicine has opened its Center for Connected Care to centralize the health system’s telemedicine activities.

Roche to Pay $1.9B for Flatiron Health

Switzerland-based pharmaceutical company Roche has agreed to pay $1.9 billion to buy New York-based Flatiron Health Inc., which has both an oncology EHR and data analytics platform.

Financial Exec Survey: Interoperability Key Obstacle to Value-Based Payment Models

Momentum continues to grow for value-based care as nearly three-quarters of healthcare executives report their organizations have achieved positive financial results from value-based payment programs, to date, according to a new study from the Healthcare Financial Management Association (HFMA).

Cerner, Children's National to Help UAE Pediatric Center with Health IT

Al Jalila Children's Specialty Hospital, the only pediatric hospital in the United Arab Emirates, has entered into an agreement with Washington, D.C.-based Children's National Health System to form a health IT strategic partnership.