MIRROR, MIRROR ON THE WALL: AN UPDATE ON THE QUALITY OF AMERICAN HEALTH CARE THROUGH THE PATIENT’S LENS Karen Davis, Cathy Schoen, Stephen C. Schoenbaum, Anne-Marie J. Audet, Michelle M. Doty, Alyssa L. Holmgren, and Jennifer L. Kriss The Commonwealth Fund April 2006 ABSTRACT: This report is based on two surveys of patients: the first was conducted in 2004 among a nationally representative sample of adults in Australia, Canada, New Zealand, the United Kingdom, and the United States; the second was conducted in 2005 among a sample of adults with health problems in the same five nations and Germany. It ranks patients’ ratings of various dimensions of their health care, according to the Institute of Medicine’s framework for quality. The U.S. system ranked first on measures of effectiveness but ranked last on other dimensions of quality. It performed particularly poorly in terms of providing care equitably, safely, efficiently, or in a patient-centered manner. For all countries, responses indicate room for improvement. Yet, the other five countries spend considerably less on health care per person and as a percent of gross domestic product than the United States. Support for this research was provided by The Commonwealth Fund. The views presented here are those of the authors and not necessarily those of The Commonwealth Fund or its directors, officers, or staff. This and other Fund publications are online at www.cmwf.org. To learn more about new publications when they become available, visit the Fund’s Web site and register to receive e-mail alerts. Commonwealth Fund pub. no. 915. CONTENTS About the Authors.......................................................................................................... iv Executive Summary....................................................................................................... vii Introduction .................................................................................................................... 1 Methods .......................................................................................................................... 3 Results............................................................................................................................. 4 Patient Safety ............................................................................................................. 4 Effectiveness............................................................................................................... 5 Patient-Centeredness.................................................................................................. 8 Timeliness.................................................................................................................. 9 Efficiency................................................................................................................. 10 Equity...................................................................................................................... 11 Discussion...................................................................................................................... 12 Tables............................................................................................................................ 16 Notes............................................................................................................................. 22 Methodology Appendix................................................................................................. 24 LIST OF FIGURES AND TABLES Figure ES-1 International Rankings and National Health Expenditures........................ viii Figure 1 International Comparison of Spending on Health, 1980–2003..................... 1 Figure 2 International Rankings and National Health Expenditures........................... 4 Table 1 Patient Safety Measures: Frequency and Country Rankings, Sicker Adults 2005 .................................................................................... 16 Table 2 Effectiveness Measures: Frequency and Country Rankings, 2004 and Sicker Adults 2005 ..................................................................... 17 Table 3 Patient-Centeredness Measures: Frequency and Country Rankings, 2004 and Sicker Adults 2005 ..................................................................... 18 Table 4 Timeliness Measures: Frequency and Country Rankings, Sicker Adults 2005 .................................................................................... 19 Table 5 Efficiency Measures: Frequency and Country Rankings, Sicker Adults 2005 .................................................................................... 20 Table 6 Equity Measures: Frequency and Country Rankings, 2004 and Sicker Adults 2005 ..................................................................... 21 iii ABOUT THE AUTHORS Karen Davis, Ph.D., president of The Commonwealth Fund, is a nationally recognized economist with a distinguished career in public policy and research. Before joining the Fund, she served as chairman of the Department of Health Policy and Management at The Johns Hopkins Bloomberg School of Public Health, where she also held an appointment as professor of economics. She served as deputy assistant secretary for health policy in the Department of Health and Human Services from 1977 to 1980, and was the first woman to head a U.S. Public Health Service agency. A native of Oklahoma, she received her doctoral degree in economics from Rice University, which recognized her achievements with a Distinguished Alumna Award in 1991. Ms. Davis has published a number of significant books, monographs, and articles on health and social policy issues, including the landmark books Health Care Cost Containment; Medicare Policy; National Health Insurance: Benefits, Costs, and Consequences; and Health and the War on Poverty. Cathy Schoen, M.S., is senior vice president for health policy, research, and evaluation at The Commonwealth Fund and has oversight responsibilities for survey work and The Commonwealth Fund Commission on a High Performance Health System Scorecard project. Previously, Ms. Schoen was director of special projects at the University of Massachusetts Labor Relations and Research Center and on the research faculty of the UMass School of Public Health. During the 1980s, she directed the Service Employees International Union’s Research and Policy Department in Washington, D.C. Earlier, she served as a member of the staff of President Carter’s national health insurance task force and as a senior health advisor during the 1988 presidential campaign. Prior to federal service, she was a research fellow at the Brookings Institution. She holds an undergraduate degree in economics from Smith College and a graduate degree in economics from Boston College. She is the author and coauthor of many publications on health care coverage and quality issues. Stephen C. Schoenbaum, M.D., M.P.H., is executive vice president for programs of The Commonwealth Fund and Executive Director of The Commonwealth Fund Commission on a High Performance Health System with responsibility for coordinating the development and management of the Fund’s program areas. He is also a member of the Fund’s executive management team. Prior to joining the Fund in February 2000, he was president of Harvard Pilgrim Health Care of New England and senior vice president of Harvard Pilgrim Health Care, responsible for delivery system operations in a mixed staff and network model HMO with approximately 150,000 members. Prior to joining Harvard Community Health Plan in 1981, Dr. Schoenbaum was a member of the iv Department of Medicine at Brigham and Women’s Hospital and did epidemiologic research in obstetrics and infectious diseases. He is a lecturer in the Department of Ambulatory Care and Prevention, Harvard Medical School, the author of more than 125 scientific articles and papers, and the editor of a book on measuring clinical care. Dr. Schoenbaum received an A.B. from Swarthmore College with honors, an M.D. from Harvard Medical School (cum laude), and an M.P.H. from Harvard School of Public Health. He also completed the Program for Management Development at Harvard Business School. Anne-Marie J. Audet, M.D., vice president for quality improvement at The Commonwealth Fund, is responsible for the Fund’s program to improve the quality of health care services. Dr. Audet has worked in the field of quality improvement for over a decade and brings to the Fund a deep understanding of the science of quality improvement, as well as an appreciation of the barriers and enablers that come into play when having to translate knowledge into real-world situations. At the national level, Dr. Audet worked in policy analysis at the American College of Physicians. At the state level, she led the implementation of the Medicare Health Care Quality Improvement Program in Massachusetts while working at the Massachusetts Peer Review Organization. More recently, she worked at the level of a health care institution and an integrated network of care with CareGroup. Prior to joining the Fund, Dr. Audet served as director of the Office for Clinical Effectiveness/Process Improvement at Beth Israel Deaconess Medical Center in Boston, where she was responsible for development of quality measurement systems, educational programs, and institution-wide medication safety initiatives. She was coeditor of “Clinical Crossroads,” a series published monthly in JAMA. Dr. Audet holds a B.Sc. in cell and molecular biology and an MDCM and M.Sc. from McGill University and an S.M. in health policy and management from Harvard University. Michelle McEvoy Doty, Ph.D., M.P.H., a senior analyst for the Health Policy, Research, and Evaluation department at The Commonwealth Fund, conducts research examining health care access and quality among vulnerable populations and the extent to which lack of health insurance contributes to barriers to health care and inequities in quality of care. She received her M.P.H. and Ph.D. in public health from the University of California, Los Angeles. Alyssa L. Holmgren is research associate for the president of The Commonwealth Fund and also provides assistance to staff in the research and evaluation area. Ms. Holmgren has also served as program associate for the State Innovations program and health care coverage and access, and as program assistant for The Commonwealth Fund’s Task Force v on the Future of Health Insurance. Prior to joining the Fund, she worked with AmeriCorps in Puerto Rico as the coordinator of an economic empowerment program for high school girls. She is currently a candidate for a master of public administration degree in public sector and nonprofit management and policy from New York University’s Wagner Graduate School of Public Service. Jennifer L. Kriss is program assistant for the Program on the Future of Health Insurance and the State Innovations Program at The Commonwealth Fund. Editorial support was provided by Martha Hostetter. vi EXECUTIVE SUMMARY U.S. health care leaders often say that American health care is the best in the world. However, recent studies of medical outcomes and mortality and morbidity statistics suggest that, despite spending more per capita on health care and devoting to it a greater percentage of its national income than any other country, the United States is not getting commensurate value for its money. The Commonwealth Fund’s cross-national surveys of patients’ views and experiences of their health care systems offer opportunities to assess U.S. performance relative to other countries through the patients’ perspective—a dimension often missing from international comparisons. In 2004, we reported on U.S. performance using Commonwealth Fund international survey data from 2001 and 2002.1 This report updates these findings using data from two recent surveys. The first survey was conducted in 2004 among a nationally representative sample of adults in five nations: Australia, Canada, New Zealand, the United Kingdom, and the United States. The second survey was conducted in 2005 among a sample of adults with health problems in the same five nations and Germany. This report ranks the countries in terms of patients’ reports on care experiences and ratings on various dimensions of care.2 While focusing on a limited slice of the health care quality picture—patient perceptions of care received—as well as a limited number of countries, the surveys nonetheless offer valuable insights. We organized patients’ responses according to the Institute of Medicine’s (IOM) framework for quality, outlined in the six bulleted points below. We then ranked each country’s score on individual items from highest to lowest. For each IOM quality domain, we calculated a summary ranking by averaging the individual ranked scores within each country and ranking these averages from highest to lowest score. Overall, the findings indicate that the U.S. health care system often performs relatively poorly from the patient perspective. The U.S. system ranked first on effectiveness but ranked last on other dimensions of quality (Figure ES-1). It performed particularly poorly in terms of providing care equitably, safely, efficiently, or in a patient- centered manner. On measures of timeliness, the U.S. system did not score as well as some of the other countries and rarely received top scores. For all countries, responses indicate room for improvement. Yet, the other five countries spend considerably less on health care per person and as a percent of gross domestic product than the United States. These findings indicate that, from the perspective of the patients it serves, the U.S. health care system could do much better in achieving high-quality performance for the nation’s substantial investment in health. vii Figure ES-1. International Rankings and National Health Expenditures AUS CAN GER NZ UK US Overall Ranking 4 5 1 2 3 6 Patient Safety 4 5 2 3 1 6 Effectiveness 4 2 3 6 5 1 Patient- 3 5 1 2 4 6 Centeredness Timeliness 4 6 1 2 5 3 Efficiency 4 5 1 2 3 6 Equity 2 4 5 3 1 6 Health Expenditures $2,903 $3,003 $2,996 $1,886 $2,231 $5,635 per Capita* Note: 1=highest ranking, 6=lowest ranking. * Health expenditures per capita figures are adjusted for differences in cost of living. Source: B.K. Frogner and G.F. Anderson, Multinational Comparisons of Health Systems Data, 2005 (New York: The Commonwealth Fund, Apr. 2006). Health expenditures data are from 2003, except UK data (2002). Key Findings • Patient safety: Among sicker adults, Americans had the highest rate of receiving wrong medications or doses in the prior two years.3 Among sicker adults who had a lab test in the past two years, adults in the U.S. were more likely than their counterparts in the other countries to have been given incorrect results or experienced delays in notification about abnormal results, with rates double those reported in Germany or the U.K. Rates of lab errors were also relatively high in Canada. • Effectiveness: The indicators of effectiveness in the 2004 and 2005 surveys were grouped into four categories: prevention, chronic care, primary care, and hospital care and coordination. Compared with the other five countries, U.S. patients fared particularly well on receipt of preventive care and care for the chronically ill, although all countries had considerable room for improvement. Canada scored well on primary care, and Germany ranked first on hospital care and coordination. Across the indicators of effectiveness, the U.S. ranked first and New Zealand ranked last. • Patient-centeredness: In 2004 and 2005, survey questions asked patients to rate the quality of their physician care in four areas: communication, choice and viii continuity, patient engagement, and responsiveness to patient preference. On measures of communication and patient engagement, New Zealand ranked highest. Germany was first on measures of choice and continuity, and Australia performed well on responsiveness to patient preference. Across the measures of patient-centeredness, Germany generally was highest, followed by New Zealand. The U.S. ranked last on nearly all aspects of patient-centeredness. • Timeliness: Germany and the U.S. stand out among the six countries in terms of patients with health problems reporting the least difficulty waiting to see a specialist or have elective or non-emergency surgery. Yet Americans, along with Canadians, were more likely to say they waited six days or more for an appointment with a doctor or had trouble getting care on nights and weekends. Across all five measures of timeliness, Germany and New Zealand ranked first and second, respectively. The U.K. ranked fifth, and Canada ranked last. • Efficiency: The 2005 survey included four questions on coordination of care that serve as indicators of health care system efficiency. Compared with their counterparts in other countries, sicker adults in the U.S. more often reported that they visited the emergency room for a condition that could have been treated by a regular doctor had one been available and that their medical records or test results failed to reach their doctor’s office in time for appointments. About one of four U.S. sicker adults reported these concerns. U.S. sicker adults, along with their German counterparts, also were more likely to be sent for duplicate tests by different clinicians. On measures of efficiency, the U.S. ranked last among the six countries, with Germany and New Zealand ranking first and second, respectively. • Equity: Nine measures from the two surveys gauged the extent to which patients’ income affected their ability to access care. The U.S. scored last on seven of the nine measures of low-income patients not receiving needed care and had the greatest disparities in terms of access to care between those with below-average and above-average incomes. With low rankings on all measures, the U.S. ranked last among the six countries in terms of equity in the health care system. The U.K. ranked first, with no or negligible differences in terms of patients’ access to care by income. The U.S. is the only country surveyed with large numbers of uninsured, and this contributed to its low rating for equity in the health care system. But even among above-average income respondents, the U.S. lagged considerably behind their counterparts in other countries. ix Summary and Implications These rankings summarize evidence on measures of quality as perceived or experienced by patients. They do not capture important dimensions of effectiveness or efficiency that might be obtained from medical records or administrative data. Patients’ assessments might be affected by their experiences and expectations, which could differ by country and culture. Yet, reports from the World Health Organization (WHO) that compare health care system performance using measures such as life expectancy, infant mortality, or preventable years of life lost as well as health expenditures also suggest that the U.S. achieves the least for its population among these six countries.4 A working group— supported by The Commonwealth Fund and with experts from each of the five countries surveyed in 2004, the Organization for Economic Cooperation and Development (OECD), and WHO—developed a set of indicators that provide measures of clinical effectiveness.5 It found that none of the five countries included in the study—Australia, Canada, New Zealand, the U.K., and the U.S.—were systematically best or worst on measures of clinical effectiveness, confirming the mixed story reported by patients. On four of the six domains of quality of care included in the Institute of Medicine framework, the U.S. performs relatively poorly from the patients’ perspective. On timeliness, the U.S. performs about average. Effectiveness was the only measure on which the U.S. system performed slightly better than the five other countries, due largely to greater use of preventive care services and better care for the chronically ill. Notably, both of these dimensions of quality have been the focus of quality and reporting measurement in the U.S. for more than a decade.6 Findings from the 2004 and 2005 surveys confirm many of the findings from surveys in 2001 and 2002.7 In the earlier surveys, the U.S. ranked last on measures of patient safety, patient-centeredness, efficiency, and equity. However, compared with the earlier surveys, the U.S. has improved on measures of effectiveness, from being tied for last place with Australia to ranking first among the six countries. The earlier surveys included only limited effectiveness measures while the more recent surveys contained a broader array of measures. The findings suggest that, if the health care system is to perform according to patients’ expectations, the U.S. will need to remove financial barriers to care and improve the delivery of care. Disparities in terms of access to services signal the need to expand insurance to cover the uninsured and to ensure that the system works well for all Americans. Based on these patient reports, the U.S. should improve the delivery, coordination, and equity of the health care system. x MIRROR, MIRROR ON THE WALL: AN UPDATE ON THE QUALITY OF AMERICAN HEALTH CARE THROUGH THE PATIENT’S LENS INTRODUCTION Health care leaders in the United States often say that the American health care system is the best in the world, despite the absence of consistent scientific evidence on its performance. Like the queen in the “Snow White” fairy tale, Americans too often look only at our own reflection in the mirror—failing to include international experience in assessments of our health care system. With U.S. per capita spending on health more than double the average among Organization for Economic Cooperation and Development (OECD) industrialized nations, and with the percentage of national income devoted to health care far exceeding all other nations, Americans should expect commensurate value and superior performance (Figure 1). Cross-national studies provide an opportunity to spotlight areas where the U.S. performs poorly or well and to set goals to improve the return on the nation’s substantial investment. Figure 1. International Comparison of Spending on Health, 1980–2003 Average spending on health Total expenditures on health per capita ($US PPP*) as percentage of GDP 6000 16 United States Germany 14 5000 Canada France 12 Australia 4000 United Kingdom 10 3000 8 6 2000 United States 4 Germany France 1000 2 Canada Australia United Kingdom 0 0 1980 1985 1990 1995 2000 2003 1980 1985 1990 1995 2000 2003 * PPP = Purchasing power parity — an estimate of the exchange rate required to equalize the purchasing power of different currencies, given the prices of goods and services in the countries concerned. Source: Organisation for Economic Co-operation and Development (OECD) Health Data, 2004. In the first major attempt to rank health care systems, the World Health Organization’s World Health 2000 report placed the U.S. health system 37th in the world.8 This calls into question the value Americans receive for their country’s investment in 1 health care. The U.S. ranked 24th in terms of “health attainment,” even lower (32nd) in terms of “equity of health outcomes” across its population, and lower still (54th) in terms of “fairness of financial contributions” toward health care. In the same report, the U.S. ranked first in terms of “patient responsiveness.” Some experts have criticized the report’s measures, methods, and data, including the fact that the data did not include information derived directly from patients.9 Cross-national surveys of patients offer a unique dimension that has been missing from international studies of health care system performance, including the WHO analysis. When such surveys include a common set of questions, they can overcome differences among national data systems and definitions that frustrate cross-national comparisons. Since 1998, The Commonwealth Fund has supported surveys about patients’ experiences with their health care system in Australia, Canada, New Zealand, the United Kingdom, and the United States.10 For the first time in 2005, Germany was included in the international survey.11 Focusing on access to care, costs, and quality, these surveys enable assessment of important dimensions of health system performance. However, they have their own limitations. In addition to lacking clinical data on effectiveness of care and economic data on efficiency, the surveys focus on a limited slice of the health care quality picture— patient perceptions of the care they received. They also include a limited number of countries. Yet, because these six countries have varying health care systems that serve diverse populations, the surveys offer insights for industrialized nations that—while they might have unique national contexts—face similar cost and quality issues. Comparing patient- reported experiences in these countries can inform the ongoing debate over how to make the U.S. health care system more effective and responsive to patient needs. Although health system evaluations can focus on a number of dimensions, including health status, coverage, financial sustainability, and political viability, this report focuses on just one dimension: quality, as it is perceived and experienced by patients.12 To add to our understanding of overall health system performance and illustrate the utility of including patient reports in health system assessments, we summarize what has been learned from the Fund’s international surveys regarding the six dimensions of quality set forth by the Institute of Medicine (IOM) in Crossing the Quality Chasm.13 Quality itself is a multifaceted concept, taking into account measures of safety, effectiveness, efficiency, and equity and ideally looking at them from a number of different perspectives, including those of providers, purchasers, and patients. This report provides patients’ views, without which an understanding of how the U.S. performs on these dimensions of quality would not be complete. 2 METHODS The IOM’s six dimensions of quality are safety, effectiveness, patient-centeredness, timeliness, efficiency, and equity. Patient-reported care experiences are particularly well suited to assessing patient-centeredness, timeliness, and equity. Some patient-reported measures also lend insight into selected aspects of safety, efficiency, and effectiveness. Data are drawn from the Commonwealth Fund 2004 International Health Policy Survey, conducted by telephone in Australia, Canada, New Zealand, the United Kingdom, and the United States, and the 2005 International Health Policy Survey of Sicker Adults, conducted in the same five countries plus Germany. The 2004 survey focuses on the primary care experiences of nationally representative samples of adults ages 18 and older in the five countries. The 2005 survey targets a representative sample of “sicker adults,” defined as those who rated their health status as fair or poor, had a serious illness in the past two years, had been hospitalized for something other than a normal delivery, or had undergone major surgery in the past two years.14 Approximately 1,400 adults in Australia, Canada, New Zealand, and the U.S. and 3,000 adults in the U.K. were included in 2004. Approximately 700 to 750 sicker adults in Australia, Canada, and New Zealand and 1,500 or more in the U.K., U.S., and Germany were included in 2005. The total sample across all countries was 8,672 in 2004 and 6,958 in 2005. The 2004 survey focuses on patients’ self-reported experiences getting and using health care services, as well as their opinions on health system structure and recent reforms. The 2005 survey examines sicker patients’ views of the health care system, quality of care, care coordination, medical errors, patient–physician communication, waiting times, and access problems. Further details of the survey methodology are described in the Methodology Appendix and elsewhere.15 For this report, we selected and grouped measures from these two surveys according to IOM’s six dimensions of quality. Safety was measured by three items, effectiveness by 15 items, patient-centeredness by 15 items, timeliness by five items, and efficiency by four items. For the measure of equity, we compared experiences of adults with incomes above or below national median incomes to examine low-income experiences across countries and differences between those with lower and higher incomes for each of nine measures. We ranked countries by calculating means and ranking these scores from highest to lowest (where 1 equals the highest score) across the six countries. For ties in means, the tied observations were assigned the average of the ranks that would be assigned if there were no ties. For each IOM domain of quality, a summary ranking was calculated by averaging the individual ranked scores within each country and ranking these averages 3 from highest (value=1) to lowest (value=6) score. (For more details, see the Methodology Appendix.) RESULTS Figure 2, below, provides a snapshot of how the six nations ranked on the domains of patient safety, effectiveness, patient-centeredness, timeliness, efficiency, and equity. Figure 2. International Rankings and National Health Expenditures AUS CAN GER NZ UK US Overall Ranking 4 5 1 2 3 6 Patient Safety 4 5 2 3 1 6 Effectiveness 4 2 3 6 5 1 Patient- 3 5 1 2 4 6 Centeredness Timeliness 4 6 1 2 5 3 Efficiency 4 5 1 2 3 6 Equity 2 4 5 3 1 6 Health Expenditures $2,903 $3,003 $2,996 $1,886 $2,231 $5,635 per Capita* Note: 1=highest ranking, 6=lowest ranking. * Health expenditures per capita figures are adjusted for differences in cost of living. Source: B.K. Frogner and G.F. Anderson, Multinational Comparisons of Health Systems Data, 2005 (New York: The Commonwealth Fund, Apr. 2006). Health expenditures data are from 2003, except UK data (2002). Patient Safety The IOM defines safety as “avoiding injuries to the patients from the care that is intended to help them.” The 2005 survey asked sicker adults about their perceptions of medication or medical errors by a doctor, hospital, or pharmacist.16 It also asked patients who had had a lab test ordered in the prior two years if they had been given incorrect results or experienced delays in being notified about abnormal results. Table 1 summarizes country findings on each of these measures of safety. In each of the six countries, at least 9 percent of the surveyed population reported receiving wrong medications or doses and at least 12 percent reported experiencing a medical error in the prior two years. Sicker adults in the U.S. reported the highest rates of medical and medication errors. Among adults who had a lab test in the previous two years, adults in the U.S. were significantly more likely to have been given incorrect results or experienced 4 delays in being notified about abnormal results, with rates double those reported in Germany or the U.K. Rates of lab errors were also relatively high in Canada. The U.S. ranked last on the summary score of the three safety measures, and the U.K. ranked first. Differences in education, cultural norms, and media attention, as well as the subjective nature of communication between doctors and patients, might influence patients’ perceptions of error. Therefore, caution must be used in relying only on patients’ perceptions to rank safety. Nevertheless, these findings indicate that Americans have serious concerns about medical errors. Effectiveness Effectiveness is defined by the IOM as “providing services based on scientific knowledge to all who could benefit and refraining from providing services to those not likely to benefit.” Although patients are not reliable reporters of the scientific basis of the care they have received, they can provide information on their experiences receiving care. In the analysis, we used measures of effectiveness such as patients’ use of preventive care services, management of chronic conditions, primary care services, and hospital care and coordination. The effectiveness measures are drawn from the 2004 survey of the general population and the 2005 survey of sicker adults. Prevention: Preventive care is crucial to an effective health care delivery system. When utilized appropriately, preventive care services such as Pap smears, mammograms, flu vaccinations, and reminders for preventive care visits can increase the effectiveness of care by the early diagnosis or prevention of illness. The U.S. does especially well in providing preventive care for its population. Although the differences were not significant, among women ages 25 to 64, American respondents reported the highest rates of getting Pap smears in the last two years (85%) and, among women ages 50 to 64, the highest rate of mammograms in the last two years (84%). Respondents in the U.S. also were more likely than those in the other countries to receive preventive care reminders. Chronic Care: Carefully managing the care of patients with chronic illnesses is another sign of an effective health care system. As a measure of this, the 2005 survey asked respondents with chronic diseases if they were receiving a self-care plan. It also asked diabetic respondents whether, in the past year, they had their cholesterol checked, an eye exam, and their feet examined and whether, in the past six months, they had their 5 hemoglobin A1c checked. Of respondents with hypertension, it asked if their blood pressure and cholesterol were checked in the past year. Among the six countries, Canada stands out for offering the chronically ill self-care plans. Only one of three (35%) Canadian respondents were not receiving a self-care plan, compared with nearly two of three (63%) German respondents. The proportion of diabetic patients receiving all four recommended services varied from 38 percent in Canada to 58 percent in the U.K. Fifty-six percent of respondents in the U.S. received all four services. The proportion of hypertensive patients receiving both blood pressure and cholesterol checks in the past year ranged from 72 percent in the U.K. to 91 percent in Germany, with the U.S. in the mid-range at 85 percent. Primary Care: Primary care also plays an important role in an effective health care system. Primary care providers offer an entry point to care, deliver core medical and preventive services, and help patients coordinate and integrate their care. The 2005 survey of sicker adults included two questions on doctors’ prescription of medications: one asking if in the past two years doctors had reviewed all of their medications and the second asking how often doctors had explained the side effects of any medication prescribed in the past two years. Explaining medications is related both to effectiveness and safety. If physicians do not explain medications, patients might not know what beneficial effects to expect (e.g., hypertension drugs should produce a difference in blood pressure, an effect that patients cannot feel). This could result in decreased adherence and, consequently, a decrease in the intended effectiveness of a therapeutic plan. Further, if physicians do not explain medications, patients might discontinue a medication prematurely because they experience unexpected side effects. On the first measure, Germany scored highest, with only 38 percent of sicker patients who were taking prescriptions regularly reporting that doctors sometimes, rarely, or never reviewed all of the different medications they were taking. One of three (33%) such patients in New Zealand reported that their doctors sometimes, rarely, or never explained the side effects of medication prescribed in the past two years. In the other countries, as many as one of two patients reported these problems. These scores highlight the need for better communication between doctors and patients across all six countries. The 2005 survey examined the extent to which patients understood and were able to follow up on physician care recommendations. These are measures of effectiveness, given that physicians are able to make recommendations for care based on available 6 scientific evidence, and patient non-adherence prevents the application of that evidence. The 2005 survey included three questions about whether patients received recommended care: whether patients got a recommended test, treatment, or follow-up care; filled a prescription; or skipped doses of medications to make them last longer. The U.S. population fared much worse than other populations surveyed in terms of going without needed care because of cost. Americans were the most likely to say they did not get a recommended test, treatment, or follow-up care; did not fill a prescription; or skipped doses of medications to make them last longer because of cost. U.K. patients were the least likely to report any one of these problems. The one primary care measure on which the U.S. performed relatively well was whether respondents received advice from a doctor on diet and exercise. Only one of three (35%) Americans did not receive such advice, compared with 54 percent of respondents in the U.K. and Germany. Hospital Care and Coordination: Especially among a sicker population, the care received and coordinated within hospitals is indicative of the effectiveness of the system overall. The 2005 survey asked questions regarding the effectiveness of hospital treatment, such as whether patients developed an infection while in the hospital, whether the hospital arranged a follow-up visit with a doctor or other professional when the patient was being discharged, and whether anyone discussed with the patient any other medications that he or she was using before being admitted to the hospital. In each country surveyed except Germany, 7 to 10 percent of patients reported developing an infection while in the hospital (Table 2). Only 3 percent of German hospital patients developed an infection. Half of German respondents said, however, that they had not received a follow-up appointment, compared with one of five (19%) patients in the U.K. and one of four (27%) in the U.S. Among respondents who had been taking a medication before hospitalization and were given a new prescription when leaving the hospital, 14 percent in Germany said no one discussed with them the other medications they were taking before they were hospitalized. The rate was more than twice as high in the U.S. (33%). In summary, the U.S. ranked higher than the other countries on measures of effectiveness, although performance varied greatly from measure to measure. The U.S. was strongest on preventive care and chronic care management, and weakest on patients 7 following through on physician recommendations on filling prescriptions or obtaining follow-on care because of costs. Patient-Centeredness The IOM defines patient-centeredness as “providing care that is respectful of and responsive to individual patient preferences, needs, and values and ensuring that patient values guide all clinical decisions.” The 2004 and 2005 surveys explored issues related to provider–patient communication, choice and continuity, patient engagement, and responsiveness to patient preferences. Communication: Measures of communication asked whether patients had left their doctor’s office without having important questions answered and whether their physicians had not listened carefully to their health concerns. Patients who had been hospitalized were asked whether risks had been explained to them in an understandable way and whether they had received clear instructions about what to watch for or when to seek further care. U.S. respondents fared quite poorly on the first two measures and very well on the last two. While only 15 percent of respondents in the U.K. reported leaving the doctor’s office without having all of their important questions answered, nearly one of four (24%) U.S. respondents had this problem. Fifteen percent of U.S. respondents also said that their doctor sometimes, rarely, or never listened carefully to their health concerns. On the other hand, only one of 10 (11%) U.S. respondents who had been hospitalized left the hospital without receiving clear instructions about symptoms to watch for and when to seek further care, compared with one of four (26%) patients in the U.K. Choice and Continuity: Americans tended to fare worse than patients in other countries on measures of choice and continuity. Only one-half of U.S. respondents had been with the same doctor for five years or more, compared with more than three- quarters (78%) of respondents in Germany. The U.S. ranked in the middle in terms of satisfaction with the choice of doctor—78 percent of U.S. patients were somewhat or very satisfied, compared with 70 percent of Canadian patients and 84 percent of New Zealand patients. Patient Engagement: The surveys measured patient engagement by asking respondents whether their regular doctor sometimes, rarely, or never tells them about their options for care and asks their opinions; makes clear the specific goals of treatment; or gives clear instructions about symptoms to watch for and when to seek treatment. A 8 fourth measure asked respondents’ who had been hospitalized whether their doctors or nurses involved them as much as they would have liked in deciding about care, treatment, or tests. The U.S. ranked best in terms of this last measure. Yet, overall, involvement in decision-making remains a problem for U.S. patients. As shown in Table 3, the U.S. ranked or tied for last on three of the four measures of patient engagement. Three-eighths (in New Zealand, 37%) to one-half (in U.S. and U.K., 50%) of sicker adults reported that their regular doctor sometimes, rarely, or never tells them about care options or asks for their opinions. Sixteen percent (in New Zealand) to 27 percent (in U.S. and U.K.) of sicker adults reported that their regular doctor does not make clear the specific goals for treatment. Nearly three of 10 (28%) U.S. adults reported that their doctor does not give clear instructions about symptoms to watch for and when to seek further care or treatment. Responsiveness to Patient Preference: Measures of physicians’ responsiveness to patients included percent of patients: reporting that their physician sometimes, rarely, or never spends enough time with them; who are able to e-mail their doctor; and who have access to their own medical records. U.S. respondents scored last on the first measure, with 25 percent reporting that their doctor did not spend enough time with them. Among respondents with internet access who wanted to e-mail their doctors, U.S. patients fared poorly as well. Fifty-seven percent were unable to e-mail their doctors, compared with only 37 percent in Australia. Also, three of four Americans wanted but did not have access to their medical records. In the summary rankings across all the measures of patient-centeredness, Germany ranked first and the U.S. ranked last. Timeliness The IOM defines timely care as “reducing waits and sometimes harmful delays for both those who receive and those who give care.” Measures of timeliness included in the 2005 survey asked sicker patients about days waiting for appointments with a regular physician, difficulty receiving care on nights and weekends, waiting times for emergency care, waiting times for seeing specialists when needed, and waiting times for admission for elective or non-emergency surgery. Different national patterns surface for different measures of timeliness, depending on the particular health care service. The U.S. and Germany had relatively short waiting times for seeing a specialist or obtaining elective, non-emergency surgery (Table 4). 9 Specialist and elective surgery waiting times were longest in the U.K., and long waits were reported in Australia, Canada, and New Zealand as well. The U.S. and Canada scored poorly on ability to get medical attention when needed. The U.S. and Australia ranked last on obtaining care on nights or weekends. Overall, Germany ranks a solid first on timeliness scores by type of services. The U.K. and Canada ranked last. Efficiency The IOM defines efficient care as “avoiding waste, including waste of equipment, supplies, ideas, and energy.” From a microeconomic point of view, efficiency means producing a given service at the lowest possible cost. Other than asking about perceptions of waste or duplication, asking patients to report on efficiency in the health care system is difficult. As a result, the surveys included only a few measures of care coordination that, taken together, can be indicators of efficiency from the patients’ perspective. In the 2005 survey of sicker adults, adults were asked whether: they visited an emergency department for a condition that could have been treated by a regular doctor had one been available; their medical records or test results did not reach a physician’s office in time for an appointment; they were sent for duplicate tests by different health care professionals; or they were rehospitalized or went to the emergency department for complications during recovery. As shown in Table 5, the U.S. had the highest percentage (26%) of sicker adults reporting that they visited an emergency department for a condition that could have been treated by a regular doctor, had one been available. Only 6 percent of German respondents reported this problem. U.S. patients also ranked last on percent of respondents whose medical records or test results did not reach the doctor’s office in time for their appointment in the previous two years, while Germany again ranked first. About one of five U.S. as well as German respondents (18% and 20%, respectively) had duplicate tests performed by different health care providers in the past two years, compared with 6 percent in the U.K. and 9 percent in New Zealand. American respondents reported fewer instances of rehospitalizations or going to the emergency department for complications during recovery, although Germany performed slightly better (14% vs. 10%, respectively). In the summary ranking, Germany ranked first and the U.S. ranked last. 10 Equity The IOM defines equity as “providing care that does not vary in quality because of personal characteristics such as gender, ethnicity, geographic location, and socioeconomic status.” We grouped adults by two income categories: those who reported their incomes as above the country median and those who reported their incomes as below the country median. In all six countries, adults reporting below-average incomes were more likely to report chronic health problems (not shown). Thus, reports from these lower-income adults provide particularly sensitive measures for how well each country performs in terms of meeting the needs of its most vulnerable population. In Table 6, we compare patient reports on various measures of access to care for adults reporting their incomes as below average and those reporting their incomes as above average. The table ranks responses within each income group and displays percentage-point differences within countries for the two income groups. We used survey measures expected to be sensitive to financial barriers to care, including not getting needed or recommended care, including dental care, because of costs and difficulty getting care when needed. The U.S. had the greatest percentage-point disparities by income for each measure and, as a result, ranked a clear last on all measures of equity. Moreover, Americans with below-average incomes were much more likely than their counterparts in other countries to report not visiting a physician when sick, not getting a recommended test, treatment or follow-up care, not filling a prescription, or not seeing a dentist when needed because of costs. On all of these indicators, more than two-fifths of lower-income adults in the U.S. said they went without needed care because of costs in the past year. Americans with below- average incomes also reported receiving lower-quality care and less efficient care. In addition, Americans with below-average incomes were significantly more likely than their counterparts in other countries to report difficulty getting care in the evenings, on weekends, or on holidays. Even among the higher-income population, U.S. respondents often were more likely than their counterparts in other countries to report difficulty obtaining needed care because of costs. The U.K. scored highest on equity, with only small differences between lower- and higher-income adults on most measures. Differences by income in Australia, Canada, and New Zealand most often emerged for services covered least well in universal national insurance programs, namely prescription drugs and dental care. 11 The U.S. is the only country surveyed without a universal health insurance system. On all measures included in Table 6, uninsured adults were more likely than insured adults to report difficulties getting needed care or going without care because of costs. However, disparate experiences by income persist even after taking insurance status into account. Compared with insured Americans with above-average incomes, insured Americans with below-average incomes were more likely to report going without care because of costs and difficulties seeing a specialist when needed. Compared with their counterparts in the five other countries, low-income Americans were significantly more likely to have access problems related to cost, even after controlling for health status and insurance. DISCUSSION This examination provides evidence of deficiencies in terms of the quality of care in the U.S. health system, as reflected in the patients’ mirror. Although the U.S. spends more on health care than any other country and has the highest rate of specialist physicians per capita, survey findings indicate that from the patients’ perspective the quality of American health care is less than optimal. The nation’s substantial investment in health care is not yielding returns in terms of public satisfaction with the health care system. Based on these patients’ views, the U.S. rarely outperforms the other nations included; on most measures of the quality of care, it ranked last or second-to-last. Among the six countries, the U.S. performed particularly poorly on measures of equity and meeting the health care needs of its vulnerable populations. The U.S. also ranked last on patient perceptions of safety, patient-centeredness, and efficiency. The U.S. ranked first only on measures of the effectiveness of care. In terms of timeliness, the U.S. ranked third among the six countries; Germany and New Zealand outperformed the U.S. in terms of providing prompt access to care. There are, of course, limits to reliance on patient perspectives to assess quality of care. Patient surveys are perhaps most useful when assessing timeliness and physician– patient communication. Unlike medical records or administrative data, patient surveys typically contain few direct measures of effectiveness or efficiency since patients are not usually in positions to report on these dimensions of care. Yet, reports from the World Health Organization (WHO) that compare health care system performance using measures such as life expectancy, infant mortality, or preventable years of life lost as well as health expenditures also suggest that the U.S. achieves the least for its population among these five countries.17 A working group—supported by The Commonwealth Fund and with experts from each of the five countries surveyed in 2004, the Organization for Economic Cooperation and Development (OECD), and WHO—developed a set of indicators that 12 provide measures of clinical effectiveness.18 It found that none of the five countries included in the 2004 study—Australia, Canada, New Zealand, the U.K., and the U.S.— were systematically best or worst on measures of clinical effectiveness, confirming the mixed story reported by patients. It is difficult to disentangle the effects of health insurance coverage from the quality of care experiences reported by U.S. patients. Comprehensiveness of insurance and stability of coverage are likely to play a role in patients’ access to care and interactions with physicians. We found that insured Americans and higher-income Americans were more likely than their counterparts in other countries to report problems such as not getting recommended tests, treatments, or prescription drugs. This might be a reflection of the lack of comprehensive health insurance coverage and the high out-of-pocket costs for care in the U.S., even among the insured and those with above-average incomes. Fragmented insurance coverage and insurance instability undermine efforts in the U.S. to improve care coordination, including the sharing of information among providers. Like those used in the WHO report, the measures, methods, and data used in this analysis are far from perfect. Different measures, moreover, are not weighted based on independent evidence of what patients value most highly. One definition of “quality” care is health services that meet or exceed consumer expectations. Even if the expectations of U.S. patients were higher than patients in other countries, the U.S. health care system should be held to the standard of meeting its consumers’ needs. Thus, while patient perspectives are only one lens from which to view health systems, the overall conclusion remains: the U.S. health care system is not the “fairest of them all,” at least from the viewpoint of those who use it to stay healthy, get better, or manage their chronic illnesses or who are vulnerable because of low income and poor health. Why does the American public consistently give low ratings to our health care system? What can be done to improve this situation? Americans report that they face a number of barriers in getting high-quality care. Inadequacies of insurance coverage certainly contribute to these problems and to the inequities between insured and uninsured patients and between high-income and low-income patients reported here. The U.S. is the only country among the six—indeed, among all major industrialized countries—not to have a universal system of health coverage. In 2004, the number of uninsured Americans rose to 45.8 million, a 6 million increase over the previous two years.19 Patients in the U.S. also pay a much higher percentage of health care expenses out of pocket than do patients in the other countries.20 13 Improving on patient-reported dimensions of quality in the U.S. will require a sustained effort to improve coordination of care and promote the adoption of systems that support better transfer of information across multiple providers of care and assist clinicians in providing safe and effective care. The 2003 Survey of Hospital Executives found that, if given new funding to invest in a one-time capital improvement to improve quality of patient care in one area of the hospital, 62 percent of hospital executives in the U.S. would put it toward electronic medical records or information technology.21 Thirty-five percent of Australian hospital executives, 47 percent of Canadian hospital executives, 46 percent of New Zealand hospital executives, and 38 percent of U.K. hospital executives would do the same.22 Other countries’ experiences suggest models for the U.S. to explore in seeking to improve its health system performance. The U.K. ranked high on measures of equity and patient safety. New Zealand ranked high on measures of patient-centered care and efficiency. Germany ranked high on efficiency and timeliness. Rather than focus solely on best practices within its borders, the U.S. would benefit from analysis of promising innovations in other countries and greater investment in cross-national research. In addition to looking at models of care from other countries, we need to find better ways to diffuse models that have been shown to be effective locally, or within the context of demonstration projects. For example, there is evidence that an advanced access approach to scheduling office visits can enable patients to make appointments—even walk-in or same-day appointments—that match their needs.23 But this practice has not been widely implemented. Wennberg and colleagues have developed a shared decision- making process that has been proven to raise patients’ levels of satisfaction with the communication process, which the surveys identify as a major source of problems.24 In this case, the benefits apply to many dimensions of quality, including patient- centeredness, effectiveness, and safety. Yet, such approaches and tools are not widely used by physicians and their patients, pointing to the need for more effective diffusion strategies. These results indicate a consistent relationship between how a country performs in terms of equity and how patients then rate performance on other dimensions of quality: the lower the performance score for equity, the lower the performance on other measures. This suggests that, when a country fails to meet the needs of the most vulnerable, it will be judged most harshly by its citizens. Rather than disregarding its performance on equity as a separate and lesser concern, the U.S. should devote far greater attention to seeing that the health system works well for all Americans. These findings raise fundamental questions 14 about the current trend in the U.S. to increase patients’ out-of-pocket costs, and about the lack of action on the growing numbers of uninsured and underinsured. The U.S. needs to make a major commitment to improving health insurance coverage and quality of care. If it fails to act, not only will the U.S. standing among the world’s health systems continue to erode, but there will be a predictable rise in public dissatisfaction and significant economic and human costs. 15 Table 1. Patient Safety Measures: Frequency and Country Rankings, Sicker Adults 2005** YEAR AUS CAN GER NZ UK US Overall Ranking 4 5 2 3 1 6 Given the wrong medication or wrong dose by a 10% 10% 10% 9%* 10% 13% 2005 doctor, nurse, hospital, or pharmacist in past 2 years (3.5) (3.5) (3.5) (1) (3.5) (6) Believed a medical mistake was made in your 13 15 13 14 12* 15 2005 treatment or care in past 2 years (2.5) (5.5) (2.5) (4) (1) (5.5) Either been given incorrect results for a diagnostic or lab test or experienced delays in being notified 14 18 9* 14 11 23 2005 about abnormal test results in past 2 years (3.5) (5) (1) (3.5) (2) (6) (base: had a lab test ordered in past 2 years) Note: Country ranking for each item indicated in parentheses. * Best country is significantly different from worst country at p < 0.05. ** Average rankings are assigned to tied observations; “1” equals highest positive score. 16 Table 2. Effectiveness Measures: Frequency and Country Rankings, 2004 and Sicker Adults 2005** YEAR AUS CAN GER NZ UK US Overall Ranking 4 2 3 6 5 1 Prevention 3 5 2 4 1 68% 70% 69% 58% 85% Women ages 25–64 who had Pap test in past 2 years 2004 — (4) (2) (3) (5) (1) 71 71 77 63 84 Women ages 50–64 who had mammogram in past 2 years 2004 — (3.5) (3.5) (2) (5) (1) 77* 66 67 74 72 Adults age 65 and older who had a flu shot in past year 2004 — (1) (5) (4) (2) (3) 37 38 44 49 50* Receive reminders for preventive care 2004 — (5) (4) (3) (2) (1) Chronic Care 4.5 2 3 6 4.5 1 49% 35%* 63% 43% 53% 41% Chronically ill not receiving self-care plan*** 2005 (4) (1) (6) (3) (5) (2) 41 38 55 40 58* 56 Diabetics receiving all four recommended services† 2005 (4) (6) (3) (5) (1) (2) Hypertensive patients receiving blood pressure and 78 85 91* 77 72 85 2005 cholesterol check (4) (2.5) (1) (5) (6) (2.5) Primary Care 3 1 4 5 6 2 Doctor sometimes, rarely, or never reviewed all medications, 46% 39% 38%* 46% 44% 40% including those prescribed by other doctors (base: taking 2005 (5.5) (2) (1) (5.5) (4) (3) prescriptions regularly) Doctor sometimes, rarely, or never explained the side effect 37 41 50 33* 48 47 2005 of medications (base: taking prescriptions regularly) (2) (3) (6) (1) (5) (4) 41 40 54 47 54 35* Did not receive advice from doctor on diet and exercise 2005 (3) (2) (5.5) (4) (5.5) (1) 67 62* 71 72 63 Doctor did not ask if emotional issues were affecting health 2004 — (3) (1) (4) (5) (2) Did not fill a prescription; skipped recommended medical test, 34 26 28 38 13* 51 treatment, or follow-up; or had a medical problem but did not 2005 (4) (2) (3) (5) (1) (6) visit doctor or clinic in the past 2 years, because of cost Hospital Care and Coordination 2 4 1 6 3 5 8% 7% 3%* 10% 10% 7% Hospitalized patients reporting infection in hospital 2005 (4) (2.5) (1) (5.5) (5.5) (2.5) Hospital did not make arrangements for follow-up visits with a 23 30 50 23 19* 27 2005 doctor or other health care professional when leaving the hospital (2.5) (5) (6) (2.5) (1) (4) No one discussed other medications you were using before you 23 28 14* 31 27 33 were hospitalized (base: taking prescription before hospitalization 2005 (2) (4) (1) (5) (3) (6) and given a new prescription when leaving the hospital) Note: Country ranking for each item indicated in parentheses. * Best country is significantly different from worst country at p < 0.05. ** Average rankings are assigned to tied observations; “1” equals highest positive score. *** Chronic conditions include diabetes, high blood pressure, or high cholesterol. † Recommended services include hemoglobin A1c checked in past six months and feet examined, eye exam, and cholesterol checked in past year. 17 Table 3. Patient-Centeredness Measures: Frequency and Country Rankings, 2004 and Sicker Adults 2005 YEAR AUS CAN GER NZ UK US Overall Ranking 3 5 1 2 4 6 Communication 5 6 2 1 3 4 Left a doctor’s appointment without getting important 20% 21% 17% 17% 15%* 24% 2005 questions answered in the past 2 years (4) (5) (2.5) (2.5) (1) (6) Doctor sometimes, rarely, or never listens carefully to patient’s 9 12 7* 11 15 2004 — health concerns (2) (4) (1) (3) (5) Before receiving a treatment or procedure while hospitalized, 18 21 12* 17 16 14 risks were not explained in an understandable way (among 2005 (5) (6) (1) (4) (3) (2) those who had been hospitalized) Did not receive clear instructions about symptoms to watch 18 17 23 14 26 11* for and when to seek further care when leaving the hospital 2005 (4) (3) (5) (2) (6) (1) (among those who had been hospitalized) Choice and Continuity 4 5 1 3 2 6 61% 65% 78%* 61% 69% 50% With same doctor 5 years or more 2005 (4.5) (3) (1) (4.5) (2) (6) 80 70 84* 80 78 Somewhat or very satisfied with choice of doctor 2004 — (2.5) (5) (1) (2.5) (4) Patient Engagement 2.5 4 2.5 1 5 6 Regular doctor sometimes, rarely, or never tells you about 46% 40% 42% 37%* 50% 50% 2005 care, treatment choices and asks opinions (4) (2) (3) (1) (5.5) (5.5) Regular doctor sometimes, rarely, or never makes clear the 21 22 22 16* 27 27 2005 specific goals for care or treatment (2) (3.5) (3.5) (1) (5.5) (5.5) Regular doctor sometimes, rarely, or never gives clear 19 24 21 16* 27 28 2005 instructions about symptoms, when to seek further care (2) (4) (3) (1) (5) (6) Doctors or nurses did not involve patient as much as he/she 22 27 21 19 22 16* wanted to be in deciding about care, treatment, or tests 2005 (4.5) (6) (3) (2) (4.5) (1) (among those who had been hospitalized) Responsiveness to Patient Preference 1 4 2 3 5 6 Doctor sometimes, rarely, or never spends enough 14% 17% 12%* 17% 25% 2004 — time with patient (2) (3.5) (1) (3.5) (5) Hospital staff sometimes, rarely, or never did everything 17* 19 18 21 21 26 they could to help control pain 2005 (1) (3) (2) (4.5) (4.5) (6) (base: those who had been hospitalized and experienced pain) Hospital staff did not do everything they could to control 30 34 33 24* 36 2004 — patient’s pain in ER (2) (4) (3) (1) (5) Not able to e-mail with MD and wants to 37* 50 51 60 57 2004 — (base: have access to internet) (1) (2) (3) (5) (4) 67 73 64* 59 75 Does not have and wants access to own medical record 2004 — (2) (4) (1) (3) (5) Note: Country ranking for each item indicated in parentheses. * Best country is significantly different from worst country at p < 0.05. 18 Table 4. Timeliness Measures: Frequency and Country Rankings, Sicker Adults 2005 YEAR AUS CAN GER NZ UK US Overall Ranking 4 6 1 2 5 3 Last time needed medical attention had to wait 10% 36% 13% 3%* 15% 23% 2005 6 or more days for an appointment (2) (6) (3) (1) (4) (5) Somewhat or very difficult to get care on nights 59 54 25* 28 39 61 or weekends 2005 (5) (4) (1) (2) (3) (6) (base: sought care) Waiting time for emergency care was greater than 2 hours 33 42 15* 26 30 29 2005 (base: used an emergency room in past 2 years) (5) (6) (1) (2) (4) (3) 46 57 22* 40 60 23 Waiting time to see a specialist was longer than 4 weeks 2005 (4) (5) (1) (3) (6) (2) Waiting time of 4 months or more for 19 33 6* 20 41 8 elective/non-emergency surgery 2005 (3) (5) (1) (4) (6) (2) (base: those needing elective surgery in past year) Note: Country ranking for each item indicated in parentheses. * Best country is significantly different from worst country at p < 0.05. 19 Table 5. Efficiency Measures: Frequency and Country Rankings, Sicker Adults 2005 YEAR AUS CAN GER NZ UK US Overall Ranking 4 5 1 2 3 6 Visited ED for a condition that could have been 15% 21% 6%* 9% 12% 26% treated by a regular doctor, had he/she been 2005 (4) (5) (1) (2) (3) (6) available Medical records/test results did not reach MD 12 19 11* 16 16 23 2005 office in time for appointment, in past 2 years (2) (5) (1) (3.5) (3.5) (6) Sent for duplicate tests by different health care 11 10 20 9 6* 18 2005 professionals, in past 2 years (4) (3) (6) (2) (1) (5) Hospitalized patients went to ER or re- 20 16 10* 15 17 14 2005 hospitalized for complication after discharge (6) (4) (1) (3) (5) (2) Note: Country ranking for each item indicated in parentheses. * Best country is significantly different from worst country at p < 0.05. 20 Table 6. Equity Measures: Frequency and Country Rankings, 2004 and Sicker Adults 2005** Percentage-Point Difference Between Below-Average Income Above-Average Income Below-Average and Above-Average Income YEAR AUS CAN GER NZ UK US AUS CAN GER NZ UK US AUS CAN GER NZ UK US Overall Ranking 4 5 2 3 1 6 6 3 1 4 2 5 2 4 5 3 1 6 Had medical problem but did 18% 10% 20% 32% 5%* 44% 19% 4% 10% 25% 2%* 17% –1 6 10 7 3 27 not visit doctor because of cost 2005 (3) (2) (4) (5) (1) (6) (5) (2) (3) (6) (1) (4) (1) (3) (5) (4) (2) (6) in the past year Did not get recommended test, 23 15 17 24 5* 44 20 7 12 19 6* 19 3 8 5 5 –1 25 treatment, or follow-up 2005 (4) (2) (3) (5) (1) (6) (6) (2) (3) (4.5) (1) (4.5) (2) (5) (3.5) (3.5) (1) (6) because of cost in the past year Did not fill prescription or 22 26 15 22 9* 51 19 10 11 16 9* 25 3 16 4 6 0 26 skipped doses because of cost 2005 (3.5) (5) (2) (3.5) (1) (6) (5) (2) (3) (4) (1) (6) (2) (5) (3) (4) (1) (6) in the past year Needed dental care but did 43 39 41 24* 52 29 19 34 17* 25 14 20 7 7 27 not see dentist because of cost 2004 — — — (4) (2) (3) (1) (5) (4) (2) (5) (1) (3) (3) (4) (1.5) (1.5) (5) in past year 9* 11 9* 12 22 7 8 4* 11 7 2 3 5 1 15 Rated doctor fair/poor 2004 — — — (1.5) (3) (1.5) (4) (5) (2.5) (4) (1) (5) (2.5) (2) (3) (4) (1) (5) Unnecessary duplication of 6 8 7 5* 17 7 5 8 4* 9 –1 3 –1 1 8 2004 — — — medical tests in past 2 years (2) (4) (3) (1) (5) (3) (2) (4) (1) (5) (1.5) (4) (1.5) (3) (5) % waiting 2 hours or more 38 45 15* 26 29 32 35 45 14* 28 30 27 3 0 1 –2 –1 5 in ER 2005 (5) (6) (1) (2) (3) (4) (5) (6) (1) (3) (4) (2) (5) (3) (4) (1) (2) (6) (base: those going to ER) Last time need medical 15 35 14 4* 17 27 7 35 10 1* 15 14 8 0 4 3 2 13 attention had to wait 6 or 2005 (3) (6) (2) (1) (4) (5) (2) (6) (3) (1) (5) (4) (5) (1) (4) (3) (2) (6) more days for an appointment Somewhat or very difficult to 44 44 16* 24 30 55 48 46 14* 18 26 48 –4 –2 2 6 4 7 get care in the evenings, on 2005 (4.5) (4.5) (1) (2) (3) (6) (5.5) (4) (1) (2) (3) (5.5) (1) (2) (3) (5) (4) (6) weekends, or holidays Note: Country ranking for each item indicated in parentheses. * Best country is significantly different from worst country at p < 0.05. ** Average rankings are assigned to tied observations; “1” equals highest positive score. 21 NOTES 1 K. Davis, C. Schoen, S. C. Schoenbaum, A.-M. J. Audet, M. M. Doty, and K. Tenney, Mirror, Mirror on the Wall: Looking at the Quality of American Health Care Through the Patient’s Lens (New York: The Commonwealth Fund, Jan. 2004). 2 In each of the past eight years, The Commonwealth Fund has performed a survey in these five countries, and last year the Fund added Germany to the survey. In each year the ministers of health have met to review the findings. 3 The 2005 survey of “sicker” adults included those who rated their health as fair or poor or who in the past two years had a serious illness, been hospitalized for care other than a normal delivery, or had major surgery. 4 World Health Organization, The World Health Report 2000—Health Systems: Improving Performance (Geneva: WHO, 2000). Available at http://www.who.int/whr2001/2001/archives/ 2000/en/contents.htm. 5 P. S. Hussey, G. F. Anderson, R. Osborn, C. Feek, V. McLaughlin, J. Millar, and A. Epstein, “How Does the Quality of Care Compare in Five Countries?” Health Affairs, May/June 2004 23(3):89–99. 6 National Committee for Quality Assurance, The State of Health Care Quality 2005 (Washington, D.C.: NCQA, 2005). 7 Davis et al., Mirror, Mirror, 2004. 8 WHO, World Health Report, 2000. 9 R. J. Blendon, M. Kim, and J. M. Benson, “The Public Versus the World Health Organization on Health System Performance,” Health Affairs, May/June 2001 20(3):10–20; C. Murray, K. Kawabata, and N. Valentine, “People’s Experience Versus People’s Expectations,” Health Affairs, May/June 2001 20(3):21–24; J. Mulligan, J. Appleby, and A. Harrison, “Measuring the Performance of Health Systems,” BMJ, July 22, 2000 321(7255):191–92; V. Navarro, “Assessment of the World Health Report 2000,” Lancet, Nov. 4, 2000 356(9241):1598–601; C. Almeida, P. Braveman, M. R. Gold et al., “Methodological Concerns and Recommendations on Policy Consequences of the World Health Report 2000,” Lancet, May 26, 2001 357(9269):1692–97; D. B. Evans, A. Tandon, C. J. Murray et al., “Comparative Efficiency of National Health Systems: Cross National Econometric Analysis,” BMJ, Aug. 11, 2001 323(7308):307–10; P. Braveman, B. Starfield, and H. J. Geiger, “World Health Report 2000: How It Removes Equity from the Agenda for Public Health Monitoring and Policy,” BMJ, Sept. 22, 2001 323(7314):678–81. 10 Commonwealth Fund 1998 International Health Policy Survey, Commonwealth Fund 1999 International Health Policy Survey of the Elderly, Commonwealth Fund 2000 International Health Policy Survey of Physicians, Commonwealth Fund 2001 International Health Policy Survey, Commonwealth Fund 2002 International Health Policy Survey of Adults with Health Problems, Commonwealth Fund 2004 International Health Policy Survey of Adults’ Experiences with Primary Care. 11 Commonwealth Fund 2005 International Health Policy Survey of Sicker Adults. Funding for Germany was provided by the German Institute for Quality and Economic Efficiency in Health Care. 12 WHO, World Health Report, 2000. 22 13 Committee on Quality of Health Care in America, Institute of Medicine, Crossing the Quality Chasm: A New Health System for the 21st Century (Washington, D.C.: National Academies Press, 2001). 14 The 2005 survey identified “sicker” adults using screening questions. For a description of the methodology, see C. Schoen, R. Osborn, P. T. Huynh, M. M. Doty, K. Zapert, J. Peugh, and K. Davis, “Taking the Pulse of Health Care Systems: Experiences of Patients with Health Problems in Six Countries,” Health Affairs Web Exclusive (Nov. 3, 2005):W5-509–W5-525. 15 C. Schoen, R. Osborn, P. T. Huynh, M. M. Doty, K. Davis, K. Zapert, and J. Peugh, “Primary Care and Health System Performance: Adults’ Experiences in Five Countries,” Health Affairs Web Exclusive (Oct. 28, 2004):W4-487–W4-503; Schoen et al., “Taking the Pulse,” 2005. 16 Two U.S. surveys have used similar questions to measure patient safety: R. J. Blendon, C. M. DesRoches, M. Brodie et al., “Views of Practicing Physicians and the Public on Medical Errors,” New England Journal of Medicine, Dec. 12, 2002 347(24):1933–40; and K. Davis, S. C. Schoenbaum, K. S. Collins, K. Tenney, D. L. Hughes, and A.-M. J. Audet, Room for Improvement: Patients Report on the Quality of Their Health Care (New York: The Commonwealth Fund, Apr. 2002). 17 WHO, World Health Report, 2000. 18 Hussey et al., “Quality of Care Compare,” 2004. 19 U.S. Census, Current Population Survey, available at http://www.census.gov. 20 P. T. Huynh, C. Schoen, R. Osborn, and A. L. Holmgren, The U.S. Health Care Divide: Disparities in Primary Care Experiences by Income—Findings from the Commonwealth Fund 2004 International Health Policy Survey (New York: The Commonwealth Fund, Apr. 2006). 21 C. Schoen, R. J. Blendon, C. M. DesRoches, R. Osborn, E. Raleigh, P. T. Huynh, A. Ho, and K. Zapert, The Commonwealth Fund 2003 International Health Policy Survey of Hospital Executives (chartpack) (New York: The Commonwealth Fund, Sept. 2004). 22 Ibid. 23 M. Murray and D. M. Berwick, “Advanced Access: Reducing Waiting and Delays in Primary Care,” Journal of the American Medical Association, Feb. 26, 2003 289(8):1035–40. 24 J. E. Wennberg, “Shared Decision-Making and the Future of Managed Care,” Disease Management and Clinical Outcomes, Jan. 1997 1(1):15–16. 23 METHODOLOGY APPENDIX Data come from two surveys, the Commonwealth Fund 2004 International Health Policy Survey, which explores primary care experiences among nationally representative samples of adults, and the 2005 International Health Policy Survey of Sicker Adults, which focuses on the experiences of adults with a high incidence of chronic disease and recent, intensive use of the medical care system. The 2004 survey was conducted between March 29 and May 17 by telephone among a random representative sample of adults ages 18 and older in Australia, Canada, New Zealand, the United Kingdom, and the United States. Except for minor wording changes to reflect terminology differences, the same instrument was used in each country. The survey was conducted in English, with a French option in Canada and a Spanish option in the United States. The final sample included 1,400 in Australia, 1,410 in Canada, 1,400 in New Zealand, 3,061 in the United Kingdom, and 1,401 in the United States. Data are weighted in each country to adjust for variations between the sample demographics and known population parameters. The margin of sampling error is approximately plus or minus three percentage points for differences between countries and plus or minus two percentage points for country averages at the 95 percent confidence level. The 2005 survey screened random samples of adults ages 18 and older in order to identify those who met at least one of four criteria: rated their health status as fair or poor; reported having a serious illness, injury, or disability that required intensive medical care in the previous two years; reported that in the past two years they had undergone major surgery; or reported that they had been hospitalized for something other than a normal delivery. The survey was conducted by telephone between March 17 and May 9 in Australia, Canada, New Zealand, the United Kingdom, and the United States and between May 9 and June 12 in Germany. The survey was conducted in German in Germany and in English in the five other countries, with the option of French in Canada and Spanish in the United States. The final sample included 702 in Australia, 751 in Canada, 704 in New Zealand, 1,503 in Germany, 1,770 in the United Kingdom, and 1,527 in the United States. After the survey data were collected, items from each survey were grouped into one of the following six dimensions of the Institute of Medicine’s (IOM) framework for quality: safety, effectiveness, patient-centeredness, timeliness, efficiency, and equity. Due 24 to the limitations of the patient surveys, some dimensions of quality were measured with a greater number of items, and some dimensions of quality were measured more robustly. After grouping survey items under one of these six domains of quality, we ranked each country’s score on individual items from highest to lowest (where 1 equals the highest score). Next, we calculated a summary ranking for each domain of quality by averaging the individual ranked scores within each country and ranking these averages from highest to lowest score. For ties in means, the tied observations were assigned the average of the ranks that would be assigned if there were no ties. Our analysis also includes chi-square tests of significance for the highest and lowest comparisons. Text, figures, and tables indicate where differences are significant at the .05 level between the highest- and lowest-ranked countries. We also looked at other methodologies used to rank countries, including an index used by the United Nations Human Development Index and the Fraser Institute Index of Human Progress to rank countries’ performances: IndexMax=W=[(country value-maximum value) / (minimum value-maximum value)] x 100. We found that the simple ranking method used in this report and the above method produced comparable results across these six countries and indicators. 25 RELATED PUBLICATIONS Publications listed below can be found on The Commonwealth Fund’s Web site at www.cmwf.org. The U.S. Health Care Divide: Disparities in Primary Care Experiences by Income—Findings from The Commonwealth Fund 2004 International Health Policy Survey (April 2006). Phuong Trang Huynh, Cathy Schoen, Robin Osborn, and Alyssa L. Holmgren, The Commonwealth Fund. Analysis by the authors of patient survey data finds that U.S. adults with below-average income fare worse than those with above-average income on 21 of 30 measures of primary care access, coordination, and doctor-patient relationships. Taking the Pulse of Health Care Systems: Experiences of Patients with Health Problems in Six Countries (November 3, 2005). Cathy Schoen, Robin Osborn, Phuong Trang Huynh, Michelle M. Doty, Kinga Zapert, Jordon Peugh, and Karen Davis. Health Affairs Web Exclusive (In the Literature summary). This international survey found that one-third of U.S. patients with health problems reported experiencing medical mistakes, medication errors, or inaccurate or delayed lab results— the highest rate of any of the six nations surveyed. Primary Care and Health System Performance: Adults’ Experiences in Five Countries (October 28, 2004). Cathy Schoen et al. Health Affairs Web Exclusive (In the Literature summary). According to a 2004 Commonwealth Fund/Harris Interactive survey of patients in five industrialized nations, a serious shortfall in the delivery of safe, effective, timely, or patient-centered primary care is an international problem. First Report and Recommendations of The Commonwealth Fund’s International Working Group on Quality Indicators (June 2004). The Commonwealth Fund. This report to the health ministers of Australia, Canada, New Zealand, the United Kingdom, and the United States provides detailed data on 40 key health care quality indicators, which the Fund’s International Working Group on Quality Indicators developed to help benchmark and compare health care system performance across the five countries. How Does the Quality of Care Compare in Five Countries? (May/June 2004). Peter S. Hussey, Gerard F. Anderson, Robin Osborn et al. Health Affairs, vol. 23, no. 3. In this article from the Fund- supported international issue of Health Affairs, the authors report on efforts of the Commonwealth Fund International Working Group on Quality Indicators to compare the quality of care in Australia, Canada, New Zealand, the United Kingdom, and the United States. Mirror, Mirror on the Wall: Looking at the Quality of American Health Care Through the Patient’s Lens (January 2004). Karen Davis, Cathy Schoen, Stephen C. Schoenbaum, Anne-Marie J. Audet, Michelle M. Doty, and Katie Tenney. This report examines how well the health system works from the perspective of patients and confirms what several other recent studies have shown—that the U.S. performs worse than its peer nations on several dimensions of quality. #534 Room for Improvement: Patients Report on the Quality of Their Health Care (April 2002). Karen Davis, Stephen C. Schoenbaum, Karen Scott Collins, Katie Tenney, Dora L. Hughes, and Anne- Marie J. Audet. Based on the Commonwealth Fund 2001 Health Care Quality Survey, this report finds that many Americans fail to get preventive health services at recommended intervals or receive substandard care for chronic conditions, which can translate into needless suffering, reduced quality of life, and higher long-term health care costs. 26