Skip to main content

Main menu

  • Home
  • Content
    • First Release
    • Current
    • Archives
    • Collections
    • Audiovisual Rheum
    • 50th Volume Reprints
  • Resources
    • Guide for Authors
    • Submit Manuscript
    • Payment
    • Reviewers
    • Advertisers
    • Classified Ads
    • Reprints and Translations
    • Permissions
    • Meetings
    • FAQ
    • Policies
  • Subscribers
    • Subscription Information
    • Purchase Subscription
    • Your Account
    • Terms and Conditions
  • About Us
    • About Us
    • Editorial Board
    • Letter from the Editor
    • Duncan A. Gordon Award
    • Privacy/GDPR Policy
    • Accessibility
  • Contact Us
  • JRheum Supplements
  • Services

User menu

  • My Cart
  • Log In

Search

  • Advanced search
The Journal of Rheumatology
  • JRheum Supplements
  • Services
  • My Cart
  • Log In
The Journal of Rheumatology

Advanced Search

  • Home
  • Content
    • First Release
    • Current
    • Archives
    • Collections
    • Audiovisual Rheum
    • 50th Volume Reprints
  • Resources
    • Guide for Authors
    • Submit Manuscript
    • Payment
    • Reviewers
    • Advertisers
    • Classified Ads
    • Reprints and Translations
    • Permissions
    • Meetings
    • FAQ
    • Policies
  • Subscribers
    • Subscription Information
    • Purchase Subscription
    • Your Account
    • Terms and Conditions
  • About Us
    • About Us
    • Editorial Board
    • Letter from the Editor
    • Duncan A. Gordon Award
    • Privacy/GDPR Policy
    • Accessibility
  • Contact Us
  • Follow Jrheum on BlueSky
  • Follow jrheum on Twitter
  • Visit jrheum on Facebook
  • Follow jrheum on LinkedIn
  • Follow jrheum on YouTube
  • Follow jrheum on Instagram
  • Follow jrheum on RSS
Research ArticleRheumatoid Arthritis

Patient Preferences for Disease-modifying Antirheumatic Drug Treatment in Rheumatoid Arthritis: A Systematic Review

Caylib Durand, Maysoon Eldoma, Deborah A. Marshall, Nick Bansback and Glen S. Hazlewood
The Journal of Rheumatology February 2020, 47 (2) 176-187; DOI: https://doi.org/10.3899/jrheum.181165
Caylib Durand
From the Department of Medicine and Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta; Arthritis Research Canada; Centre for Health Evaluation and Outcome Sciences, Providence Health Care, St. Paul’s Hospital, Vancouver, British Columbia, Canada.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Maysoon Eldoma
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Deborah A. Marshall
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Deborah A. Marshall
Nick Bansback
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Nick Bansback
Glen S. Hazlewood
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Glen S. Hazlewood
  • For correspondence: gshazlew@ucalgary.ca
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • References
  • PDF
PreviousNext
Loading

Abstract

Objective. To summarize patients’ preferences for disease-modifying antirheumatic drug (DMARD) therapy in rheumatoid arthritis (RA).

Methods. We conducted a systematic review to identify English-language studies of adult patients with RA that measured patients’ preferences for DMARD or health states and treatment outcomes relevant to DMARD decisions. Study quality was assessed using a published quality assessment tool. Data on the importance of treatment attributes and associations with patient characteristics were summarized across studies.

Results. From 7951 abstracts, we included 36 studies from a variety of countries. Most studies were in patients with established RA and were rated as medium- (n = 19) or high-quality (n = 12). The methods to elicit preferences varied, with the most common being discrete choice experiment (DCE; n = 13). Despite the heterogeneity of attributes in DCE studies, treatment benefits (disease improvement) were usually more important than both non-serious (6 of 8 studies) and serious adverse events (5 of 8), and route of administration (7 of 9). Among the non-DCE studies, some found that patients placed high importance on treatment benefits, while others (in patients with established RA) found that patients were quite risk averse. Subcutaneous therapy was often but not always preferred over intravenous therapy. Patient preferences were variable and commonly associated with the sociodemographic characteristics.

Conclusion. Overall, the results showed that many patients place a high value on treatment benefits over other treatment attributes, including serious or minor side effects, cost, or route of administration. The variability in patient preferences highlights the need to individualize treatment choices in RA.

Key Indexing Terms:
  • PATIENT PREFERENCE
  • RHEUMATOID ARTHRITIS
  • DISEASE-MODIFYING ANTIRHEUMATIC DRUGS
  • SYSTEMATIC REVIEW

Expanding treatment options for rheumatoid arthritis (RA) has led to increased choices for patients and physicians. These choices come with tradeoffs in risks and benefits, and there is growing recognition of the importance of including patient preferences in treatment decision making. With individual patients, shared decision making is regarded as the preferred approach to achieving evidence-informed decisions consistent with a patient’s values1. Within clinical practice guidelines, understanding patient preferences for key tradeoffs is a necessary step in the evidence-to-decision process2. Under the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach, strong recommendations are reserved for situations in which most patients would choose a treatment based on the balance of benefits and harms3. Summarizing the existing literature on patient preferences is a critical step in developing patient-centered guidelines.

Evidence on patient preferences can come from a variety of sources4. Researchers may record patients’ choices when presented with an informed choice, typically with a patient decision aid. Alternatively, the importance of outcomes or health states can be assessed either individually in absolute terms (unidimensional) or relative to each other (multidimensional)5. The absolute importance of a health state is usually expressed on a 0 (equivalent to death) to 100 (full health) scale. This can be derived through a simple visual analog scale (VAS) or utility elicitation techniques, where patients are asked to choose between continued existence in a given health state, or a return to full health but with a small chance of immediate death [standard gamble (SG)] or shortened life expectancy [time tradeoff (TTO)]6.

Alternatively, the relative importance of health states can be elicited through multidimensional methods such as a discrete choice experiment (DCE) that ask patients to rate, rank, or choose between treatment alternatives4. In a DCE, patients complete a series of choice tasks, in which they are presented with a choice of 2 or more treatments that differ in their attributes (e.g., characteristics such as dosing, cost, side effects, route of administration)7. The value patients place on each attribute is then estimated using statistical models, assuming that patients chose the treatment with the highest overall value.

The primary objective of our systematic review was to summarize the available quantitative evidence regarding the preferences of patients with RA for DMARD therapy. The secondary objective was to identify any associations between patient characteristics and preferences. The aim was to provide knowledge that can help inform treatment recommendations and clinical decision making for RA. By aligning treatment recommendations and decisions with patient preferences, patient adherence to DMARD therapy may increase8,9.

MATERIALS AND METHODS

Study design and inclusion criteria

We performed a systematic review to identify English-language studies in adults (age > 18) with a diagnosis of RA that assessed patients’ preferences for different DMARD, or treatment attributes relevant to a choice between DMARD. DMARD included any conventional synthetic DMARD (e.g., methotrexate), biologic originator or biosimilar DMARD (e.g., adalimumab), targeted synthetic DMARD (e.g., tofacitinib), or corticosteroids. We included any study that provided a quantitative assessment of patient preferences, which was defined according to the MeSH definition in the National Library of Medicine as an “individual’s expression of desirability or value of one course of action, outcome, or selection in contrast to others”10. This included studies that (1) examined the choices patients made when presented with a decision aid for alternate DMARD and (2) measured patient preferences for alternative treatment options or attributes relevant to a choice between DMARD.

We excluded studies reporting health-related quality of life (HRQOL) because HRQOL measures the value a patient places on their current health state and not their preference for potential treatment outcomes or attributes. We also excluded studies with mixed rheumatic disease populations, unless the data for patients with RA were reported separately. Because we were interested in information regarding patients’ preferences for attributes relevant to DMARD therapy, we excluded studies that measured patient preferences for an unrealistic outcome such as a complete cure. Finally, we also excluded studies that measured preferences for components of a single attribute (e.g., relative importance of questions within a functional status outcome, or specific mechanisms of an auto-injector); these tradeoffs were felt to be less relevant to treatment decision making in clinic or within guidelines. The study protocol was registered with Prospero (PROSPERO 2015 CRD42015027528).

Search strategy and data sources

We conducted a database search for studies on or before January 2018 in the following databases: Medline In Process and Other Non-indexed Citations, CENTRAL (Cochrane Central Registry of Controlled Trials), EMBASE (Excerta Medica Database), Psychinfo, and HealthStar. The MEDLINE search strategy is included in Supplementary Table 1 (available with the online version of this article). Briefly, the search combined keywords and subject headings for RA with terms for patient preferences or methods used to assess patient preferences. The MEDLINE and EMBASE RA filters were derived from Cochrane reviews and adapted for the other databases11. The patient preference filter was informed by a published systematic review of patient preferences12. We also reviewed the reference lists of all eligible studies.

Study selection

Two reviewers independently screened articles. Any article included by either reviewer in the title or abstract screen proceeded to full-text review, where disagreements were resolved by consensus or with a third reviewer if necessary.

Assessment of study quality

To assess for study quality and to identify potential biases, 2 reviewers used a methodological assessment tool previously developed by other investigators13. The checklist includes 31 questions to assess for potential biases across 5 domains: (1) external validity (i.e., is the studied population representative of the target population?); (2) quality of construct representation (i.e., are the health states considered appropriate, comprehensive, and meaningful?); (3) construct-irrelevant variance (i.e., were there factors outside of the measurement, such as task complexity, that may have affected responses?); (4) quality of reporting and analyses (i.e., were the data complete and analyzed appropriately?); and (5) other aspects that strengthen or weaken the study. After each of the 5 domains were evaluated, an overall quality rating (high/medium/low) was assigned to the study. The overall quality rating included a judgment across all domains for that outcome, although not all domains were equally weighted13. The quality rating was done by 2 independent reviewers, with disagreements resolved by consensus.

Data extraction and analysis

For each included study, 2 reviewers extracted the study method and considered attributes, the setting in which the study took place, number of patients involved, patient characteristics, treatment(s) of interest, and funding sources into a standardized form. The results of the studies were not combined into a metaanalysis because of the heterogeneity of the methodologies, patient populations, and treatment options evaluated. Instead, we summarized data into tables based on the type of study method used and highlighted overall themes across the body of evidence. For DCE, we summarized results across studies in a table of pairwise comparisons of attribute importance, as described below. Results for the association between patient characteristics and preferences were summarized descriptively.

For DCE studies, we calculated the proportion of times an attribute was preferred out of the total number of comparisons. For example, if remission and route of administration were both included as attributes in 3 different studies, and remission was more important in all 3, this would be presented as 3/3, favoring remission. If the number of studies in which each of the 2 attributes was favored was the same, then the word “neither” was placed above the ratio to reflect the fact that there was no overall direction of the preference. For these comparisons, we grouped similar attributes into 9 categories representing treatment benefits (remission/low disease activity, symptom/functional improvement, avoiding joint damage), adverse events (AE; serious and non-serious), dosing (onset/duration, route, frequency), and cost. If a study included more than 1 attribute in a given category (e.g., multiple AE), we considered the attribute category to be more important in that study if it was favored in the majority of pairwise comparisons. When drawing conclusions from these analyses, we were careful to consider that the attributes and levels varied considerably across studies. Thus, as a secondary summary, we also presented the utility values for each attribute and level, without summarizing across the studies. These were scaled so that they summed to 100 within each study.

RESULTS

Search results and study characteristics

From 7951 records, we included 36 unique studies (Figure 1). The included studies were published between 1990 and 2018, across multiple countries, and had sample sizes ranging from 10 to 1588 (Table 1)14–20,23–42,52–59,60–65. Most studies included patients with established RA (mean disease duration 7–17 yrs), except 2 that examined the preferences of patients with early RA14,15. Most (n = 22) were focused on health states relevant to advanced therapeutics (biologic or targeted synthetic therapy), and in most studies, patients had previously or were currently taking 1 or more of the treatments that the study was focused on. Fifteen of the studies were funded partially or entirely by industry. The methods used to elicit preferences included DCE (n = 13); SG, TTO, or VAS (n = 3); willingness to pay (WTP; n = 2); and willingness to accept risk (n = 5; Table 1). Fourteen other studies used various rating or ranking tasks to evaluate patient preferences for different routes of delivery (n = 5), different treatment outcomes (n = 6), or different treatment options (n = 3; Table 1 with full details in Table 4)15,31–38,60,61,62,63,64. The attributes considered in each study varied considerably.

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

Flowchart of literature search results. HRQOL: health-related quality of life; RA: rheumatoid arthritis.

View this table:
  • View inline
  • View popup
Table 1.

Characteristics of included studies.

Quality assessment of included studies

Overall, 12 studies were rated as high quality, 19 were medium, and 5 were low quality (Supplementary Table 2, available with the online version of this article). Low-quality studies typically had poor external validity with small sample sizes that did not reflect typical rheumatology patients with RA, and/or had complex surveys without adequate pretesting or piloting to ensure comprehension, leading to low ratings for the construct-irrelevant variance domain (i.e., understanding of the task). Most studies were rated as medium or high quality for construct representation and quality of reporting and analysis. Ratings of overall study quality were similar between DCE (4 high, 8 medium, 1 low) and non-DCE studies (8 high, 11 medium, 4 low).

Discrete choice experiments

The summary of pairwise comparisons of attribute importance across DCE studies is presented in Table 214,16,17,40,41,52–54,56–59, with additional details and calculated relative importance of attributes in Supplementary Table 3 (available with the online version of this article). For each pairwise comparison in Table 2, the attribute that was preferred most often is listed in each cell, along with the ratio of the number of times it was preferred over the total number of times those 2 attributes were compared across all studies. While the DCE studies were heterogeneous in their attributes and levels, some overall trends can be observed. Treatment benefits were often more important than both serious and non-serious AE across the ranges of levels considered in the studies. In particular, symptom/functional improvement was rated as more important than serious but rare AE in 5 of 8 studies (Table 2). Serious but rare AE were more important than more common but less serious “nuisance” side effects in 5 of 6 studies (2 ties). Cancer in particular, even when described as a “theoretical risk,” was often the most important AE14,16,17. In a study in patients with early RA, treatment benefits were the most important attribute14.

View this table:
  • View inline
  • View popup
Table 2.

Relative importance of treatment attributes across discrete choice experiment studies.

Dosing and administration considerations were typically less important than benefits, but again this varied across studies (Table 2 and Supplementary Table 3, available with the online version of this article). The route and frequency were often more important than AE, both serious and non-serious. Most studies that included cost found that patients would be willing to pay at least US$100/month for the most desirable treatment attributes, including treatment benefits or avoiding side effects.

Standard gamble, time tradeoff, and VAS

Three studies measured the absolute importance of health states on a 0 (death) to 1 (full health) scale using a SG, TTO, or VAS (Table 3)18,19,20,23–29. Chiou, et al found that the American College of Rheumatology (ACR) 50 and ACR70 responses were similar in importance and considerably higher than the ACR20 response, which would support the use of the former in outcome evaluation in RA trials18. The greatest distinction in side effects was between “severe” and “moderate” with relatively little difference between moderate and mild (Table 3). Ferraz, et al found that patients were risk-tolerant and valued the described benefits of 15 mg prednisone (well-controlled disease but a high risk of side effects) considerably more than treatments with no prednisone (severe disease but no risk of side effects)19. Suarez-Almazor and Conner-Spady found that mild arthritis had relatively little loss in use compared to severe arthritis20. From a measurement perspective, both Ferraz, et al’s study and Suarez-Almazor and Conner-Spady’s study had considerably lower values when using a VAS versus other utility-based methods20,21, which is consistent with the broader literature22.

View this table:
  • View inline
  • View popup
Table 3.

Summary of unidimensional studies assessing the absolute importance of health states and outcomes.

Willingness to pay

Two studies valued various health states directly using the WTP approach (Table 3). Slothuus, et al found that patients were willing to pay about 3× their current monthly drug expenditure for a treatment with antitumor necrosis factor properties (maximal improvement and small risk of mild infection)23,24. Tuominen, et al found that the severity of AM stiffness (which is not commonly measured in trials) was about 1.5× more important than its duration25.

Willingness to accept risk

Three studies that measured patient’s willingness to accept risk used very different approaches and had quite different findings (Table 3). Fraenkel, et al found that many patients with established RA were completely unwilling to accept even very rare (1/1000 or 1/100,000) risks associated with DMARD therapy for a beneficial treatment26,27. Similarly, Ho, et al found that patients were very unwilling to accept even a small risk of death for improvement in arthritis symptoms28. In contrast, O’Brien, et al found that patients were willing to accept a considerable risk of death for specific health benefits, which was highest for relief of pain29. The quality of these later 2 studies was, however, rated as low (Supplementary Table 2, available with the online version of this article).

Other studies

The remainder of studies used other rating or ranking methods to assess patient preferences for different modes of administration, treatment outcomes, or treatment options (Table 4). In 3 of the 5 studies examining patients’ preferred route of delivery, more patients preferred subcutaneous (SC) over intravenous (IV) therapy, although 2 of these found that 22% and 21% of patients expressed no preference30,31. The final study found preferences to be split (50%) between SC and IV32.

View this table:
  • View inline
  • View popup
Table 4.

Other studies.

In the studies that evaluated the importance of treatment outcomes, reduction in pain and improvement in function (particularly hand/finger function and walking) and fatigue were consistently identified as highly important33,34,35. An additional study identified “being dependent on others” as the worst-case scenario for patients36. In the RA-Patient Priorities for Pharmacologic Intervention questionnaire, developed through an iterative process, the 6 most important outcomes to evaluate when assessing treatment efficacy were pain, activities of daily living, joint damage, mobility, life enjoyment, independence, fatigue, and valued activities35.

Finally, 2 studies assessed patient preferences for different treatment options in the context of guidelines37 or a randomized trial15. Fraenkel, et al trained a patient panel in the GRADE approach for developing recommendations37. In 3/16 recommendations, the patient panel recommended a different treatment from the traditional physician-dominated panel because of differences in how patients valued treatment attribute tradeoffs. Patients were generally more willing to prefer the treatment with the highest chance of benefit. Similarly, in a posthoc study of patients with early RA from the BeST trial, more patients expressed a preference to be randomized to the methotrexate and infliximab arm (with the higher perceived chance of benefit) than the other trial arms. Patients also expressed a preference not to be randomized to the arm with corticosteroids15. Finally, van Overbeeke, et al found that most patients (60%) expressed no preference and trusted their physician for the decision whether to start a biosimilar or originator biologic DMARD38.

Associations between patient characteristics and treatment preferences

The observed associations between patient characteristics and preferences across studies are summarized in Supplementary Table 4 (available with the online version of this article). Overall, sociodemographic variables including age, education, ethnicity, and income were found to be associated with preferences more frequently than variables related to RA disease severity or treatment history. Two studies found that younger patients with RA placed higher importance on treatment benefits39,40 and 3 studies found that more educated patients with RA were more risk tolerant and preferred more intense treatments14,41,42. In 2 of 3 studies that examined an association between income and preferences, higher incomes were associated with greater risk tolerance14,41,42. Both studies that analyzed an association between ethnicity and risk tolerance found greater risk aversion in black patients compared to non-black patients41 and black patients compared to white patients42.

DISCUSSION

Our systematic review identified 36 studies that used various methods to investigate patient preferences for RA therapy and treatment outcomes. Among studies that compared treatment attributes, the benefits of treatment were generally more important than most risks. However, some studies found patients to be quite risk averse and there was important variability in preferences. Taken together, these results support current intensive treatment strategies, but highlight the critical need to individualize treatment decision making. For guideline developers, it suggests that many decisions may be preference sensitive. Under the GRADE approach, this would mean that for these treatment decisions, a conditional rather than a strong recommendation may be more appropriate3. Decision tools linked to these recommendations would then be encouraged to support shared decision making, which has been shown to improve decision-making quality43, and may also improve adherence44.

When grading the strength of treatment recommendations, guideline developers require an understanding of the relative importance of treatment outcomes and other attributes. With this in mind, we believe there are some general statements that are supported by the evidence:

  • Treatment benefits were usually more important than AE, but not always. In particular, some studies in patients with established RA found patients to be quite risk averse.

  • Serious but rare AE, including a hypothetical risk of cancer, were usually more important than more common but less serious AE.

  • Dosing regimens and monitoring requirements with therapy were generally less important than the benefits of treatment.

  • Patient preferences were variable and frequently associated with sociodemographic characteristics.

RA treatment approaches have moved toward a treat-to-target paradigm, with treatment escalation recommended until patients are in remission, or if not possible, low disease activity45,46,47. Implicit in this recommendation is that patients generally value the benefits of improved disease control more than any risks or undesirable aspects of treatment escalation. Overall, our findings support this, but with some caveats. Several studies showed that patients with established RA place a high importance of avoiding rare but serious AE. These patients may prefer to maintain their current treatment rather than escalate therapy in the setting of active disease that is well tolerated. This is recognized in guidelines, which support a less intensive treatment target, such as low disease activity, for some patients with established disease45,46,47. It is critical, however, that patients adequately understand both the risks of treatment and the risks of active disease. A reluctance to escalate treatment may be related to a misunderstanding of risks, particularly rare AE, which are difficult for patients to understand48. Although the evidence was not robust, 3 studies suggested that patients with early RA are relatively risk tolerant and would prefer early intensive treatment approaches with the greatest chance of benefit45,46,47. This may suggest that patients’ preferences change over time as patients adapt to their condition, which is supported by qualitative research49. It is also possible that patients with early RA in the studies were less well informed of the risks and benefits of treatment. Longitudinal studies could help clarify this.

In drawing the above conclusions, we must keep in mind the limitations of the available evidence. Several studies were judged to be of low or moderate quality, and the majority of the studies were of patients with established RA. The studies were often conducted in academic centers. Patients without access to these centers, including marginalized patient populations, may therefore be underrepresented. The majority of the studies were also industry-funded, which may have introduced bias. Most of the studies included patients currently receiving RA treatment and are therefore not reflective of the preferences of people who refuse or discontinue DMARD therapy.

Strengths of our review include the registered protocol, comprehensive search terms, and quality assessment, although the later 2 are also sources of potential limitations. Systematic reviews of patient preferences are quite new. We were over-inclusive with our search terms, but it is possible we missed relevant studies. A search filter for patient preference studies has been proposed and is in the process of being validated50. Similarly, the quality assessment of patient preference studies is not as well standardized as with other types of evidence. A systematic review identified 6 different quality rating systems, including the one we used51. Summarizing findings across studies is also challenging, given the study heterogeneity. We were careful in considering the study context in the interpretation of our findings, but it is possible others may have a somewhat different interpretation of the same evidence. Qualitative studies were also excluded; they may provide a better understanding of patient preferences but are even more challenging to summarize.

To the best of our knowledge, this is the first systematic review of patient preferences for DMARD treatment in RA. The results highlight the variability in preferences between patients, providing further rationale for efforts to promote shared decision making. For guideline developers, our review provides evidence to inform the risk/benefit tradeoffs that are required when developing and grading treatment recommendations. Guideline developers using our findings should judge whether the available evidence on patient preferences is sufficient to understand the balance of benefits and harms for their target patient population. If not, further research should be prioritized. It is hoped that our work can help inform the risk benefit tradeoffs required when deciding between RA treatments.

ONLINE SUPPLEMENT

Supplementary material accompanies the online version of this article.

Footnotes

  • The work was supported in part by a Canadian Initiative for Outcomes in Rheumatology Care grant and a Canadian Institute of Health Research (CIHR) grant (MOP - 142441). Dr. Hazlewood is supported by a CIHR New Investigator Salary Award and The Arthritis Society Young Investigator Salary Award. Dr. Marshall is supported by a CIHR Canada Research Chair in Health Services and Systems Research and the Arthur J.E. Child Chair of Rheumatology Outcomes Research.

  • Accepted for publication April 1, 2019.

REFERENCES

  1. 1.↵
    1. Elwyn G,
    2. Frosch D,
    3. Thomson R,
    4. Joseph-Williams N,
    5. Lloyd A,
    6. Kinnersley P,
    7. et al.
    Shared decision making: a model for clinical practice. J Gen Intern Med 2012;27:1361–7.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Andrews JC,
    2. Schünemann HJ,
    3. Oxman AD,
    4. Pottie K,
    5. Meerpohl JJ,
    6. Coello PA,
    7. et al.
    GRADE guidelines: 15. Going from evidence to recommendation-determinants of a recommendation’s direction and strength. J Clin Epidemiol 2013;66:726–35.
    OpenUrlCrossRefPubMed
  3. 3.↵
    1. Andrews J,
    2. Guyatt G,
    3. Oxman AD,
    4. Alderson P,
    5. Dahm P,
    6. Falck-Ytter Y,
    7. et al.
    GRADE guidelines: 14. Going from evidence to recommendations: the significance and presentation of recommendations. J Clin Epidemiol 2013;66:719–25.
    OpenUrlCrossRefPubMed
  4. 4.↵
    1. Ryan M,
    2. Scott DA,
    3. Reeves C,
    4. Bate A,
    5. van Teijlingen ER,
    6. Russell EM,
    7. et al.
    Eliciting public preferences for healthcare: a systematic review of techniques. Health Technol Assess 2001;5:1–186.
    OpenUrlPubMed
  5. 5.↵
    1. Hazlewood G
    . Measuring patient preferences: an overview of methods with a focus on discrete choice experiments. Rheum Dis Clin North Am 2018;44:337–47.
    OpenUrl
  6. 6.↵
    1. Froberg DG,
    2. Kane RL
    . Methodology for measuring health-state preferences—II: Scaling methods. J Clin Epidemiol 1989;42:459–71.
    OpenUrlCrossRefPubMed
  7. 7.↵
    1. Bridges JF
    . Stated preference methods in health care evaluation: an emerging methodological paradigm in health economics. Appl Health Econ Health Policy 2003;2:213–24.
    OpenUrlPubMed
  8. 8.↵
    1. van den Bemt BJ,
    2. van Lankveld WG
    . How can we improve adherence to therapy by patients with rheumatoid arthritis? Nat Clin Pract Rheumatol 2007;3:681.
    OpenUrlPubMed
  9. 9.↵
    1. Barton JL
    . Patient preferences and satisfaction in the treatment of rheumatoid arthritis with biologic therapy. Patient Prefer Adherence 2009;3:335–44.
    OpenUrlPubMed
  10. 10.↵
    Medical Subject Headings (MeSH). US National Library of Medicine. (Internet. Accessed April 3, 2018.) Available from: https://meshb.nlm.nih.gov/record/ui?ui=D057240
  11. 11.↵
    1. Hazlewood GS,
    2. Barnabe C,
    3. Tomlinson G,
    4. Marshall D,
    5. Devoe DJ,
    6. Bombardier C
    . Methotrexate monotherapy and methotrexate combination therapy with traditional and biologic disease modifying anti-rheumatic drugs for rheumatoid arthritis: a network meta-analysis. Cochrane Database Syst Rev 2016:CD010227.
  12. 12.↵
    1. Purnell TS,
    2. Joy S,
    3. Little E,
    4. Bridges JF,
    5. Maruthur N
    . Patient preferences for noninsulin diabetes medications: a systematic review. Diabetes Care 2014;37:2055–62.
    OpenUrlAbstract/FREE Full Text
  13. 13.↵
    1. Eiring Ø,
    2. Landmark BF,
    3. Aas E,
    4. Salkeld G,
    5. Nylenna M,
    6. Nytroen K
    . What matters to patients? A systematic review of preferences for medication-associated outcomes in mental disorders. BMJ Open 2015;5:e007848.
    OpenUrl
  14. 14.↵
    1. Hazlewood GS,
    2. Bombardier C,
    3. Tomlinson G,
    4. Thorne C,
    5. Bykerk VP,
    6. Thompson A,
    7. et al.
    Treatment preferences of patients with early rheumatoid arthritis: a discrete-choice experiment. Rheumatology 2016;55:1959–68.
    OpenUrlCrossRefPubMed
  15. 15.↵
    1. Goekoop-Ruiterman YP,
    2. de Vries-Bouwstra JK,
    3. Allaart CF,
    4. Kerstens PJ,
    5. Grillet BA,
    6. de Jager MH,
    7. et al.
    Patient preferences for treatment: report from a randomised comparison of treatment strategies in early rheumatoid arthritis (BeSt trial). Ann Rheum Dis 2007;66:1227–32.
    OpenUrlAbstract/FREE Full Text
  16. 16.↵
    1. Constantinescu F,
    2. Goucher S,
    3. Weinstein A,
    4. Smith W,
    5. Fraenkel L
    . Understanding why rheumatoid arthritis patient treatment preferences differ by race. Arthritis Rheum 2009;61:413–8.
    OpenUrlCrossRefPubMed
  17. 17.↵
    1. Fraenkel L,
    2. Bogardus S,
    3. Concato J,
    4. Felson D,
    5. Wittink D
    . Patient preferences for treatment of rheumatoid arthritis. Ann Rheum Dis 2004;63:1372–8.
    OpenUrlAbstract/FREE Full Text
  18. 18.↵
    1. Chiou CF,
    2. Weisman M,
    3. Sherbourne CD,
    4. Reyes C,
    5. Dylan M,
    6. Ofman J,
    7. et al.
    Measuring preference weights for American College of Rheumatology response criteria for patients with rheumatoid arthritis. J Rheumatol 2005;32:2326–9.
    OpenUrlAbstract/FREE Full Text
  19. 19.↵
    1. Ferraz MB,
    2. Quaresma MR,
    3. Goldsmith CH,
    4. Bennett K,
    5. Atra E
    . Corticosteroids in patients with rheumatoid arthritis: utility measurements for evaluating risks and benefits. Rev Rhum Engl Fr 1994;61:240–4.
    OpenUrl
  20. 20.↵
    1. Suarez-Almazor ME,
    2. Conner-Spady B
    . Rating of arthritis health states by patients, physicians, and the general public. Implications for cost-utility analyses. J Rheumatol 2001;28:648–56.
    OpenUrlAbstract/FREE Full Text
  21. 21.↵
    1. Ferraz MB,
    2. Quaresma MR,
    3. Goldsmith CH,
    4. Bennett K,
    5. Atra E
    . [Estimation of benefits and risks of the treatment of rheumatoid polyarthritis with glucocorticoids using the health-related quality of life measurements]. [Article in French] Rev Rhum Ed Fr 1994;61:255–9.
    OpenUrlPubMed
  22. 22.↵
    1. Dolan P,
    2. Sutton M
    . Mapping visual analogue scale health state valuations onto standard gamble and time trade-off values. Soc Sci Med 1997;44:1519–30.
    OpenUrlCrossRefPubMed
  23. 23.↵
    1. Slothuus U,
    2. Brooks RG
    . Willingness to pay in arthritis: a Danish contribution. Rheumatology 2000;39:791–9.
    OpenUrlCrossRefPubMed
  24. 24.↵
    1. Slothuus U,
    2. Larsen ML,
    3. Junker P
    . Willingness to pay for arthritis symptom alleviation. Comparison of closed-ended questions with and without follow-up. Int J Technol Assess Health Care 2000;16:60–72.
    OpenUrlCrossRefPubMed
  25. 25.↵
    1. Tuominen R,
    2. Tuominen S,
    3. Möttönen T
    . How much is a reduction in morning stiffness worth to patients with rheumatoid arthritis? Scand J Rheumatol Suppl 2011;125:12–6.
    OpenUrlPubMed
  26. 26.↵
    1. Fraenkel L,
    2. Bogardus S,
    3. Concato J,
    4. Felson D
    . Unwillingness of rheumatoid arthritis patients to risk adverse effects. Rheumatology 2002;41:253–61.
    OpenUrlCrossRefPubMed
  27. 27.↵
    1. Fraenkel L,
    2. Bogardus S,
    3. Concato J,
    4. Felson D
    . Risk communication in rheumatoid arthritis. J Rheumatol 2003;30:443–8.
    OpenUrlAbstract/FREE Full Text
  28. 28.↵
    1. Ho M,
    2. Lavery B,
    3. Pullar T
    . The risk of treatment. A study of rheumatoid arthritis patients’ attitudes. Br J Rheumatol 1998;37:459–60.
    OpenUrlCrossRefPubMed
  29. 29.↵
    1. O’Brien BJ,
    2. Elswood J,
    3. Calin A
    . Willingness to accept risk in the treatment of rheumatic disease. J Epidemiol Community Health 1990;44:249–52.
    OpenUrlAbstract/FREE Full Text
  30. 30.↵
    1. Bolge SC,
    2. Goren A,
    3. Brown D,
    4. Ginsberg S,
    5. Allen I
    . Openness to and preference for attributes of biologic therapy prior to initiation among patients with rheumatoid arthritis: patient and rheumatologist perspectives and implications for decision making. Patient Prefer Adherence 2016;10:1079–90.
    OpenUrl
  31. 31.↵
    1. Navarro-Millan I,
    2. Herrinton LJ,
    3. Chen L,
    4. Harrold L,
    5. Liu L,
    6. Curtis JR
    . Comparative effectiveness of etanercept and adalimumab in patient reported outcomes and injection-related tolerability. PLoS One 2016;11:e0149781.
    OpenUrl
  32. 32.↵
    1. Scarpato S,
    2. Antivalle M,
    3. Favalli EG,
    4. Nacci F,
    5. Frigelli S,
    6. Bartoli F,
    7. et al.
    Patient preferences in the choice of anti-TNF therapies in rheumatoid arthritis. Results from a questionnaire survey (RIVIERA study). Rheumatology 2010;49:289–94.
    OpenUrlCrossRefPubMed
  33. 33.↵
    1. da Silva JA,
    2. Ramiro S,
    3. Pedro S,
    4. Rodrigues A,
    5. Vasconcelos JC,
    6. Benito-Garcia E
    . Patients- and physicians- priorities for improvement. The case of rheumatic diseases. Acta Reumatol Port 2010;35:192–9.
    OpenUrlPubMed
  34. 34.↵
    1. Heiberg T,
    2. Kvien TK
    . Preferences for improved health examined in 1,024 patients with rheumatoid arthritis: pain has highest priority. Arthritis Rheum 2002;47:391–7.
    OpenUrlCrossRefPubMed
  35. 35.↵
    1. Sanderson T,
    2. Morris M,
    3. Calnan M,
    4. Richards P,
    5. Hewlett S
    . Patient perspective of measuring treatment efficacy: the rheumatoid arthritis patient priorities for pharmacologic interventions outcomes. Arthritis Care Res 2010;62:647–56.
    OpenUrlCrossRef
  36. 36.↵
    1. Buitinga L,
    2. Braakman-Jansen LM,
    3. Taal E,
    4. van de Laar MA
    . Worst-case future scenarios of patients with rheumatoid arthritis: a cross-sectional study. Rheumatology 2012;51:2027–33.
    OpenUrlCrossRefPubMed
  37. 37.↵
    1. Fraenkel L,
    2. Miller AS,
    3. Clayton K,
    4. Crow-Hercher R,
    5. Hazel S,
    6. Johnson B,
    7. et al.
    When patients write the guidelines: patient panel recommendations for the treatment of rheumatoid arthritis. Arthritis Care Res 2016;68:26–35.
    OpenUrl
  38. 38.↵
    1. van Overbeeke E,
    2. De Beleyr B,
    3. de Hoon J,
    4. Westhovens R,
    5. Huys I
    . Perception of originator biologics and biosimilars: a survey among Belgian rheumatoid arthritis patients and rheumatologists. BioDrugs 2017;31:447–59.
    OpenUrl
  39. 39.↵
    1. Skjoldborg US,
    2. Lauridsen J,
    3. Junker P
    . Reliability of the discrete choice experiment at the input and output level in patients with rheumatoid arthritis. Value Health 2009;12:153–8.
    OpenUrlPubMed
  40. 40.↵
    1. Augustovski F,
    2. Beratarrechea A,
    3. Irazola V,
    4. Rubinstein F,
    5. Tesolin P,
    6. Gonzalez J,
    7. et al.
    Patient preferences for biologic agents in rheumatoid arthritis: a discrete-choice experiment. Value Health 2013;16:385–93.
    OpenUrlCrossRefPubMed
  41. 41.↵
    1. Fraenkel L,
    2. Cunningham M,
    3. Peters E
    . Subjective numeracy and preference to stay with the status quo. Med Decis Making 2015;35:6–11.
    OpenUrlCrossRefPubMed
  42. 42.↵
    1. Constantinescu F,
    2. Goucher S,
    3. Weinstein A,
    4. Fraenkel L
    . Racial disparities in treatment preferences for rheumatoid arthritis. Med Care 2009;47:350–5.
    OpenUrlCrossRefPubMed
  43. 43.↵
    1. Stacey D,
    2. Légaré F,
    3. Col NF,
    4. Bennett CL,
    5. Barry MJ,
    6. Eden KB,
    7. et al.
    Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev 2014;1:CD001431.
    OpenUrlPubMed
  44. 44.↵
    1. Lofland JH,
    2. Johnson PT,
    3. Ingham MP,
    4. Rosemas SC,
    5. White JC,
    6. Ellis L
    . Shared decision-making for biologic treatment of autoimmune disease: influence on adherence, persistence, satisfaction, and health care costs. Patient Prefer Adherence 2017;11:947–58.
    OpenUrl
  45. 45.↵
    1. Bykerk VP,
    2. Akhavan P,
    3. Hazlewood GS,
    4. Schieir O,
    5. Dooley A,
    6. Haraoui B,
    7. et al;
    8. Canadian Rheumatology Association
    . Canadian Rheumatology Association recommendations for pharmacological management of rheumatoid arthritis with traditional and biologic disease- modifying antirheumatic drugs. J Rheumatol 2012;39:1559–82.
    OpenUrlAbstract/FREE Full Text
  46. 46.↵
    1. Singh JA,
    2. Saag KG,
    3. Bridges SL Jr.,
    4. Akl EA,
    5. Bannuru RR,
    6. Sullivan MC,
    7. et al.
    2015 American College of Rheumatology guideline for the treatment of rheumatoid arthritis. Arthritis Rheumatol 2016;68:1–26.
    OpenUrl
  47. 47.↵
    1. Smolen JS,
    2. Landewe R,
    3. Bijlsma J,
    4. Burmester G,
    5. Chatzidionysiou K,
    6. Dougados M,
    7. et al.
    EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2016 update. Ann Rheum Dis 2017;76:960–77.
    OpenUrlAbstract/FREE Full Text
  48. 48.↵
    1. Paling J
    . Strategies to help patients understand risks. BMJ 2003;327:745–8.
    OpenUrlFREE Full Text
  49. 49.↵
    1. Goodacre LJ,
    2. Goodacre JA
    . Factors influencing the beliefs of patients with rheumatoid arthritis regarding disease-modifying medication. Rheumatology 2004;43:583–6.
    OpenUrlCrossRefPubMed
  50. 50.↵
    1. Selva A,
    2. Sola I,
    3. Zhang Y,
    4. Pardo-Hernandez H,
    5. Haynes RB,
    6. Martinez Garcia L,
    7. et al.
    Development and use of a content search strategy for retrieving studies on patients’ views and preferences. Health Qual Life Outcomes 2017;15:126.
    OpenUrl
  51. 51.↵
    1. Yepes-Nunez JJ,
    2. Zhang Y,
    3. Xie F,
    4. Alonso-Coello P,
    5. Selva A,
    6. Schunemann H,
    7. et al.
    Forty-two systematic reviews generated 23 items for assessing the risk of bias in values and preferences’ studies. J Clin Epidemiol 2017;85:21–31.
    OpenUrl
  52. 52.↵
    1. Fraenkel L,
    2. Nowell WB,
    3. Michel G,
    4. Wiedmeyer C
    . Preference phenotypes to facilitate shared decision-making in rheumatoid arthritis. Ann Rheum Dis 2018;77:678–83.
    OpenUrlAbstract/FREE Full Text
  53. 53.
    1. Husni ME,
    2. Betts KA,
    3. Griffith J,
    4. Song Y,
    5. Ganguli A
    . Benefit-risk trade-offs for treatment decisions in moderate-to-severe rheumatoid arthritis: focus on the patient perspective. Rheumatol Int 2017;37:1423–34.
    OpenUrl
  54. 54.↵
    1. Alten R,
    2. Kruger K,
    3. Rellecke J,
    4. Schiffner-Rohe J,
    5. Behmer O,
    6. Schiffhorst G,
    7. et al.
    Examining patient preferences in the treatment of rheumatoid arthritis using a discrete-choice approach. Patient Prefer Adherence 2016;10:2217–28.
    OpenUrl
  55. 55.
    1. Hazlewood GS,
    2. Bombardier C,
    3. Tomlinson G,
    4. Marshall D
    . A Bayesian model that jointly considers comparative effectiveness research and patients’ preferences may help inform GRADE recommendations: an application to rheumatoid arthritis treatment recommendations. J Clin Epidemiol 2018;93:56–65.
    OpenUrl
  56. 56.↵
    1. Louder AM,
    2. Singh A,
    3. Saverno K,
    4. Cappelleri JC,
    5. Aten AJ,
    6. Koenig AS,
    7. et al.
    Patient preferences regarding rheumatoid arthritis therapies: a conjoint analysis. Am Health Drug Benefits 2016;9:84–93.
    OpenUrlPubMed
  57. 57.
    1. Nolla JM,
    2. Rodriguez M,
    3. Martin-Mola E,
    4. Raya E,
    5. Ibero I,
    6. Nocea G,
    7. et al.
    Patients’ and rheumatologists’ preferences for the attributes of biological agents used in the treatment of rheumatic diseases in Spain. Patient Prefer Adherence 2016;10:1101–13.
    OpenUrl
  58. 58.
    1. Poulos C,
    2. Hauber AB,
    3. Gonzalez JM,
    4. Turpcu A
    . Patients’ willingness to trade off between the duration and frequency of rheumatoid arthritis treatments. Arthritis Care Res 2014;66:1008–15.
    OpenUrlCrossRef
  59. 59.↵
    1. Ozdemir S,
    2. Johnson FR,
    3. Hauber AB
    . Hypothetical bias, cheap talk, and stated willingness to pay for health care. J Health Econ 2009;28:894–901.
    OpenUrlCrossRefPubMed
  60. 60.↵
    1. Bacalao EJ,
    2. Greene GJ,
    3. Beaumont JL,
    4. Eisenstein A,
    5. Muftic A,
    6. Mandelin AM,
    7. et al.
    Standardizing and personalizing the treat to target (T2T) approach for rheumatoid arthritis using the Patient-Reported Outcomes Measurement Information System (PROMIS): baseline findings on patient-centered treatment priorities. Clin Rheumatol 2017;36:1729–36.
    OpenUrl
  61. 61.↵
    1. van Tuyl LH,
    2. Sadlonova M,
    3. Hewlett S,
    4. Davis B,
    5. Flurey C,
    6. Goel N,
    7. et al.
    The patient perspective on absence of disease activity in rheumatoid arthritis: a survey to identify key domains of patient-perceived remission. Ann Rheum Dis 2017;76:855–61.
    OpenUrlAbstract/FREE Full Text
  62. 62.↵
    1. Desplats M,
    2. Pascart T,
    3. Jelin G,
    4. Norberciak L,
    5. Philippe P,
    6. Houvenagel E,
    7. et al.
    Are abatacept and tocilizumab intravenous users willing to switch for the subcutaneous route of administration? A questionnaire-based study. Clin Rheumatol 2017;36:1395–400.
    OpenUrl
  63. 63.↵
    1. Huynh TK,
    2. Ostergaard A,
    3. Egsmose C,
    4. Madsen OR
    . Preferences of patients and health professionals for route and frequency of administration of biologic agents in the treatment of rheumatoid arthritis. Patient Prefer Adherence 2014;8:93–9.
    OpenUrlPubMed
  64. 64.↵
    1. Martin RW,
    2. Enck RD,
    3. Tellinghuisen DJ,
    4. Eggebeen AT,
    5. Birmingham JD,
    6. Head AJ
    . Comparison of the effects of a pharmaceutical industry decision guide and decision aids on patient choice to intensify therapy in rheumatoid arthritis. Med Decis Making 2017;37:577–88.
    OpenUrl
  65. 65.↵
    1. Goekoop-Ruiterman YP,
    2. de Vries-Bouwstra JK,
    3. Allaart CF,
    4. van Zeben D,
    5. Kerstens PJ,
    6. Hazes JM,
    7. et al.
    Clinical and radiographic outcomes of four different treatment strategies in patients with early rheumatoid arthritis (the BeSt study): a randomized, controlled trial. Arthritis Rheum 2005;52:3381–90.
    OpenUrlCrossRefPubMed
View Abstract
PreviousNext
Back to top

In this issue

The Journal of Rheumatology
Vol. 47, Issue 2
1 Feb 2020
  • Table of Contents
  • Table of Contents (PDF)
  • Index by Author
  • Editorial Board (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word about The Journal of Rheumatology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Patient Preferences for Disease-modifying Antirheumatic Drug Treatment in Rheumatoid Arthritis: A Systematic Review
(Your Name) has forwarded a page to you from The Journal of Rheumatology
(Your Name) thought you would like to see this page from the The Journal of Rheumatology web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Patient Preferences for Disease-modifying Antirheumatic Drug Treatment in Rheumatoid Arthritis: A Systematic Review
Caylib Durand, Maysoon Eldoma, Deborah A. Marshall, Nick Bansback, Glen S. Hazlewood
The Journal of Rheumatology Feb 2020, 47 (2) 176-187; DOI: 10.3899/jrheum.181165

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

 Request Permissions

Share
Patient Preferences for Disease-modifying Antirheumatic Drug Treatment in Rheumatoid Arthritis: A Systematic Review
Caylib Durand, Maysoon Eldoma, Deborah A. Marshall, Nick Bansback, Glen S. Hazlewood
The Journal of Rheumatology Feb 2020, 47 (2) 176-187; DOI: 10.3899/jrheum.181165
del.icio.us logo Twitter logo Facebook logo  logo Mendeley logo
  • Tweet Widget
  •  logo
Bookmark this article

Jump to section

  • Article
    • Abstract
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • ONLINE SUPPLEMENT
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • References
  • PDF

Keywords

PATIENT PREFERENCE
RHEUMATOID ARTHRITIS
DISEASE-MODIFYING ANTIRHEUMATIC DRUGS
SYSTEMATIC REVIEW

Related Articles

Cited By...

More in this TOC Section

  • Unacceptable Work State in Rheumatoid Arthritis: Establishment of Thresholds for Presenteeism and Clinical Measurement Instruments
  • Association Between Abatacept Exposure Levels and Infection Occurrence in Patients With Rheumatoid Arthritis: Post Hoc Analysis of the AVERT-2 Study
  • Nintedanib in Rheumatoid Arthritis–Related Interstitial Lung Disease: Real-World Safety Profile and Risk of Side Effects and Discontinuation
Show more Rheumatoid Arthritis

Similar Articles

Keywords

  • patient preference
  • rheumatoid arthritis
  • disease-modifying antirheumatic drugs
  • systematic review

Content

  • First Release
  • Current
  • Archives
  • Collections
  • Audiovisual Rheum
  • COVID-19 and Rheumatology

Resources

  • Guide for Authors
  • Submit Manuscript
  • Author Payment
  • Reviewers
  • Advertisers
  • Classified Ads
  • Reprints and Translations
  • Permissions
  • Meetings
  • FAQ
  • Policies

Subscribers

  • Subscription Information
  • Purchase Subscription
  • Your Account
  • Terms and Conditions

More

  • About Us
  • Contact Us
  • My Alerts
  • My Folders
  • Privacy/GDPR Policy
  • RSS Feeds
The Journal of Rheumatology
The content of this site is intended for health care professionals.
Copyright © 2025 by The Journal of Rheumatology Publishing Co. Ltd.
Print ISSN: 0315-162X; Online ISSN: 1499-2752
Powered by HighWire