Review Article
A meta-analysis demonstrates no significant differences between patient and population preferences

https://doi.org/10.1016/j.jclinepi.2005.07.020Get rights and content

Abstract

Background and Objectives

To summarize and quantify mean differences between directly elicited patient and population health state evaluations (= preferences) and to identify factors explaining these differences.

Materials and Methods

Two meta-analyses of observational studies comparing directly elicited patient and population preferences for two stratified health state classifications: actual/hypothetical and hypothetical/hypothetical health states.

Results

Thirty-three articles comparing directly elicited patient and population preferences were included, yielding 78 independent preference estimates. These preference estimates served as input for the two stratified health state classifications. Data on health state assessments, elicitation methods, assessment method, and population characteristics was extracted by one reviewer, and checked by two other reviewers. These parameters were used to explain sources of heterogeneity. Overall, patients' actual health state preferences were not significantly higher than populations hypothetical health state preferences (summary mean difference [SMD] = −0.01, 95% confidence interval [CI] = −0.01, 0.03). Nor did preferences for hypothetical health states differ between patients and population (SMD −0.00, 95% CI = −0.02, 0.02). Most parameters substantially influenced the SMD, although the magnitude and direction differed for the two strata used (all P-values <.05).

Conclusions

The actual/hypothetical and hypothetical/hypothetical meta-analyses demonstrated no significant differences between patient and population preferences, suggesting that both can be used to allocate scarce resources.

Introduction

Cost-effectiveness and cost-utility analyses of health care interventions are increasingly used as instruments to allocate scarce resources in health care. The results of these analyses are summarized in Quality Adjusted Life Years (QALY) League Tables (QLTs). Whether these tables are appropriate decision-making tools has been extensively discussed in the literature [1], [2], [3]. One of the main shortcomings of these QLTs is that it is not always clear whether preferences are elicited from patients or from the general population. In addition, it is largely unknown whether it matters if one uses patient or population preferences [4], [5].

Preferences are quantitative expressions for certain health states and are used to calculate QALYs. They reflect the desirability of certain health states [6]. Methods for assigning preferences to health states may be choice based [e.g., Standard Gamble (SG), Time Trade-Off (TTO)] or nonchoice-based [e.g., Visual Analogue Scale (VAS), Rating Scale] [7]. The Health Utility Index (HUI), the Quality of Well-Being Scale (QWB), and the EuroQol-5D (EQ-5D) are multiattribute descriptive classification systems for generic health states with preference scores [7], [8], [9]. These instruments are suitable for economic evaluations [6], [10].

Preferences can be elicited from the patient him/herself. For some diseases, where the patient may be unable to answer questions (e.g., dementia or stroke) the judgments of physicians, other health care professionals or caregivers, so-called proxies, are used to elicit preferences. Since the Panel on Cost-Effectiveness recommended using the societal perspective for costs and effects, the general population can also be used [10]. However, the literature is ambiguous about the question whose preferences count [10], [11]. The conclusion that patient preferences are higher than [12], [13] or equal to [14], [15] population preferences is mostly derived from single articles or narrative reviews [15], [16]. These articles report mixed findings, and are confusing to those seeking guidance on decision making [17]. A meta-analytic approach may help to overcome this problem. To our knowledge, there has so far not been any attempt to summarize the literature quantitatively. The goal of our review was to analyze the difference between directly elicited patient preferences and directly elicited preferences from the general population. In the present study we applied a framework [18] to systematically identify the goals of the decision-making processes. We concentrated on the goal of guiding the decision-making process used to allocate resources. The relevant preferences were classified into the actual preferences of patients and the hypothetical preferences of the general population. The second goal of our review was to assess the bias of having experienced the disease, for which we compared the preferences of patients and the population for hypothetical health states.

Because preference studies are mostly observational studies, it is important to account for potential sources of heterogeneity [19]. As mentioned above, various methods can be used to elicit preferences and to explain the differences between patient and population preferences. Preferences can be attached to disease-specific or generic health states, or health state profiles. Hence, a health state assessment was included as a possible source of heterogeneity, as was the way preferences are assessed. External factors, such as gender, age, educational level, and type of disease (chronic, contagious, or risk factors for disease) were added [11], [15], [20], [21]. The third goal of this review was to assess the effects of different sources of heterogeneity on patient and population preferences.

Section snippets

Data sources

The literature search covered the computerized databases MEDLINE (1966–March 2005), ECONLIT (1969–March 2005), PsychINFO (1887–March 2005), CINAHL (1982–March 2005), EMBASE (1989–March 2005), and the Cochrane Library (1996–March 2005), which holds a collection of seven databases. The search was restricted to adults (≥18 years). References cited in published original and review papers were examined until no further articles were identified. No language restrictions were applied. The search

Study characteristics

Table 1 shows the characteristics of the 78 independent estimates. VAS was used to assess preferences in 52.6% of the estimates, while TTO and SG were used in 16.7% of the estimates, and EQ-5D in 65.4%. HUI and QWB were not used to assess preferences for either actual or hypothetical patient and population preferences.

To assess the severity of the health states, 23.1% of the estimates used disease-specific instruments, whereas 46.2% used generic instruments and 65.4% used a health state profile.

Conclusion

Our meta-analyses demonstrate that patient preferences for actual health state do not differ significantly from population preferences for hypothetical health state. This finding suggests that patient and population preferences can both be used to allocate resources. Moreover, the meta-analyses revealed that a variety of parameters act as sources of heterogeneity, including preference elicitation methods, health state assessment methods, study assessment methods and population characteristics.

References (118)

  • W.F. Lawrence et al.

    Health status and hypertension: a population-based study

    J Clin Epidemiol

    (1996)
  • J. Ratcliffe et al.

    Assessing health-related quality of life pre- and post-liver transplantation: a prospective multicenter study

    Liver Transplant

    (2002)
  • L. Lalonde et al.

    Health-related quality of life with coronary heart disease prevention and treatment

    J Clin Epidemiol

    (2001)
  • S.M. Schneider et al.

    Quality of life in long-term home enteral nutrition patients

    Clin Nutr

    (2000)
  • K. Gerard et al.

    QALY league tables: handle with care

    Health Econ

    (1993)
  • J. Mason et al.

    Some guidelines on the use of cost effectiveness league tables

    BMJ

    (1993)
  • P. Ubel et al.

    Whose quality of life? A commentary exploring discrepancies between health state evaluations of patients and the general public

    Qual Life Res

    (2003)
  • D.G. Fryback

    Whose quality of life? or Whose decision?

    Qual Life Res

    (2003)
  • M.F. Drummond et al.

    Methods for the Economic Evaluation of Health Care Programmes

    (1997)
  • The EuroQol Group

    EuroQol—a new facility for the measurement of health-related quality of life

    Health Policy

    (1990)
  • R.M. Kaplan et al.

    A general health policy model: update and applications

    Health Serv Res

    (1988)
  • M.R. Gold et al.

    Cost-effectiveness in health and medicine

    (1996)
  • G.A. De Wit et al.

    Sensitivity and perspective in the valuation of health status: whose values count?

    Health Econ

    (2000)
  • N.F. Boyd et al.

    Whose utilities for decision analysis?

    Med Decis Making

    (1990)
  • D.J. Balaban et al.

    Weights for scoring the quality of well-being instrument among rheumatoid arthritics. A comparison to general population weights

    Med Care

    (1986)
  • J. Ashby et al.

    The time trade-off technique: how do the valuations of breast cancer patients compare to those of other groups?

    Qual Life Res

    (1994)
  • M. Egger et al.

    Spurious precision? Meta-analysis of observational studies

    BMJ

    (1998)
  • C. Green et al.

    Valuing health-related quality of life. A review of health state valuation techniques

    Pharmacoeconomics

    (2000)
  • N.P. Hurst et al.

    Validity of Euroqol—a generic health status instrument—in patients with rheumatoid arthritis. Economic and Health Outcomes Research Group

    Br J Rheumatol

    (1994)
  • B.A. Bartman et al.

    Relationship between health status and utility measures in older claudicants

    Qual Life Res

    (1998)
  • D.L. Patrick et al.

    Economic evaluation of aquatic exercise for persons with osteoarthritis

    Med Care

    (2001)
  • C. Wang et al.

    The relationship between health related quality of life and disease activity and damage in systemic lupus erythematosus

    J Rheumatol

    (2001)
  • W.M. Sage et al.

    Is intensive care worth it? An assessment of input and outcome for the critically ill

    Crit Care Med

    (1986)
  • C.R. Nicholl et al.

    Assessing quality of life in people with multiple sclerosis

    Disabil Rehabil

    (2001)
  • J.L. Donovan et al.

    Using the ICSOoL to measure the impact of lower urinary tract symptoms on quality of life: evidence from the ICS-“BPH” Study. International Continence Society—benign prostatic hyperplasia

    Br J Urol

    (1997)
  • C. Selai et al.

    Eliciting EuroQol descriptive data and utility scale values from inpatients. A feasibility study

    Pharmacoeconomics

    (1995)
  • S.M. Lai et al.

    Stroke recovery profile and the modified Rankin assessment

    Neuroepidemiology

    (2001)
  • L.A. Merlino et al.

    Preference for fractures and other glucocorticoid-associated adverse effects among rheumatoid arthritis patients

    Med Decis Making

    (2001)
  • G.B. Chapman et al.

    A multi-attribute model of prostate cancer patient's preferences for health states

    Qual Life Res

    (1999)
  • A. Cranney et al.

    The psychometric properties of patient preferences in osteoporosis

    J Rheumatol

    (2001)
  • S.J. Jansen et al.

    Unstable preferences: a shift in valuation or an effect of the elicitation procedure?

    Med Decis Making

    (2000)
  • M. Gold et al.

    Assessing the health of the nation. The predictive validity of a preference-based measure and self-rated health

    Med Care

    (1996)
  • E.M. Andresen et al.

    Comparing the performance of health status measures for healthy older adults

    J Am Geriatr Soc

    (1995)
  • X. Badia et al.

    A comparison of United Kingdom and Spanish general population time trade-off values for EQ-5D health states

    Med Decis Making

    (2001)
  • N. Devlin et al.

    Variations in self-reported health status: results from a New Zealand survey

    N Z Med J

    (2000)
  • S. Bjork et al.

    The weighting exercise for the Swedish version of the EuroQol

    Health Econ

    (1999)
  • J.A. Rizzo et al.

    Linking health-related quality-of-life indicators to large national data sets

    Pharmacoeconomics

    (1999)
  • A. Hisashige et al.

    Description and valuation of health-related quality of life among the general public in Japan by the EuroQol

    J Med Invest

    (1998)
  • C. Jenkinson et al.

    Comparison of three measures of quality of life outcome in the evaluation of continuous positive airways pressure therapy for sleep apnoea

    J Sleep Res

    (1997)
  • C. Gudex et al.

    Health state valuations from the general public using the visual analogue scale

    Qual Life Res

    (1996)
  • Cited by (47)

    • Carer Social Care-Related Quality of Life Outcomes: Estimating English Preference Weights for the Adult Social Care Outcomes Toolkit for Carers

      2019, Value in Health
      Citation Excerpt :

      The study was reviewed and approved by the University of Kent SRC Research Ethics Committee, [REF SR CEA 149]. We estimated preferences of a general population sample (rather than a service user or carer sample), which is a common approach in the estimation of preference weights.36,37 This is because it is the public at large whose views are relevant, where services are publicly-funded, and whose data are used to make decisions about resource allocations.38

    • Estimation of Health Utilities Based on the Response to Treatment in Atopic Dermatitis: a Population-based Study

      2019, Clinical Therapeutics
      Citation Excerpt :

      However, when patients adapt to their disease, they might report higher utility values than the general population.18 In some cases, patients evaluate the utility weights higher than the general population; in general, however, it is known that patients evaluate utilities lower than or similar to the general population.19–21 Gandjour22 noted that the heath utility values of patients with chronic disease could be overestimated because patients might have adapted to their health status.

    • Questioning the differences between general public vs. patient based preferences towards EQ-5D-5L defined hypothetical health states

      2019, Health Policy
      Citation Excerpt :

      Another limitation of the use of patient preferences is the inability to assess rare adverse treatment events due to a lack of patients with relevant experience [5] and patients being able to answer [12,13]. The scientific discussion on whether QALYs should comprise patient preferences as opposed to community preferences is still ongoing [2,4,5,11–26]. Several studies provide empirical evidence on the differences between patient and general public preferences.

    View all citing articles on Scopus
    View full text