Skip to main content

Main menu

  • Home
  • Content
    • First Release
    • Current
    • Archives
    • Collections
    • Audiovisual Rheum
    • COVID-19 and Rheumatology
  • Resources
    • Guide for Authors
    • Submit Manuscript
    • Payment
    • Reviewers
    • Advertisers
    • Classified Ads
    • Reprints and Translations
    • Permissions
    • Meetings
    • FAQ
    • Policies
  • Subscribers
    • Subscription Information
    • Purchase Subscription
    • Your Account
    • Terms and Conditions
  • About Us
    • About Us
    • Editorial Board
    • Letter from the Editor
    • Duncan A. Gordon Award
    • Privacy/GDPR Policy
    • Accessibility
  • Contact Us
  • JRheum Supplements
  • Services

User menu

  • My Cart
  • Log In
  • Log Out

Search

  • Advanced search
The Journal of Rheumatology
  • JRheum Supplements
  • Services
  • My Cart
  • Log In
  • Log Out
The Journal of Rheumatology

Advanced Search

  • Home
  • Content
    • First Release
    • Current
    • Archives
    • Collections
    • Audiovisual Rheum
    • COVID-19 and Rheumatology
  • Resources
    • Guide for Authors
    • Submit Manuscript
    • Payment
    • Reviewers
    • Advertisers
    • Classified Ads
    • Reprints and Translations
    • Permissions
    • Meetings
    • FAQ
    • Policies
  • Subscribers
    • Subscription Information
    • Purchase Subscription
    • Your Account
    • Terms and Conditions
  • About Us
    • About Us
    • Editorial Board
    • Letter from the Editor
    • Duncan A. Gordon Award
    • Privacy/GDPR Policy
    • Accessibility
  • Contact Us
  • Follow jrheum on Twitter
  • Visit jrheum on Facebook
  • Follow jrheum on LinkedIn
  • Follow jrheum on YouTube
  • Follow jrheum on Instagram
  • Follow jrheum on RSS
Research ArticleOMERACT 10: 10th International Consensus Conference on Outcome Measures in Rheumatology, Kota Kinabalu, Borneo - May 4–8, 2010

Overview of the Patient Perspective at OMERACT 10 — Conceptualizing Methods for Developing Patient-Reported Outcomes

JOHN R. KIRWAN and PETER S. TUGWELL
The Journal of Rheumatology August 2011, 38 (8) 1699-1701; DOI: https://doi.org/10.3899/jrheum.110388
JOHN R. KIRWAN
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: John.Kirwan@Bristol.ac.uk
PETER S. TUGWELL
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • References
  • Info & Metrics
  • PDF
  • eLetters
PreviousNext
Loading

Abstract

This overview draws out the main conclusions from the 4 workshops focused on incorporating the patient perspective into outcome assessment at the 10th Outcome Measures in Rheumatology (OMERACT 10) conference. They raised methodological issues about the choice of outcome domains to include in clinical trials, the development or choice of instruments to measure these domains, and the way these instruments might capture the impact of a disease and its treatment. The need to develop a more rigorous conceptual model of quantifying the way conditions affect health, and the need to ensure patients are directly involved in the decisions about domains and instruments, emerged clearly. The OMERACT participants voted to develop guidelines for domain and instrument selection, and conceptual and experimental work will be brought forward to revise and upgrade the OMERACT Filter.

Key Indexing Terms:
  • OUTCOME MEASURES
  • RHEUMATOID ARTHRITIS

At the Outcome Measures in Rheumatology (OMERACT) 10 meeting, 4 workshops focused on incorporating the patient perspective into outcome assessment. Although this was more program time than at any previous OMERACT meeting, 3 of the workshops were designed to tackle fundamental issues and were principally about methods. The fourth workshop (the Virtual Campus1) offered an opportunity to reflect on other work that had been progressing between OMERACT meetings. The 3 main workshops incorporated contributions from many working groups, using reports of the activities and experiences gained in specific disease areas as a way of exploring the underlying methodological challenges and ensuring the relevance of the methodological conclusions. The workshops were arranged in the following methods sequence: (1) How to choose domains of interest in outcome assessment; (2) How to choose or develop instruments to make reliable and valid measurements within those domains; and (3) How to calibrate the changes measured for use in personal and health service decision-making. All were conducted within the framework of the OMERACT Filter2. Here we offer an overview of the main issues to arise and draw out 3 emerging ideas that require further thought and evaluation. One of these ideas explains why one of the authors wore a blue triangle on his head when addressing an OMERACT 10 plenary session (Figure 1).

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

John Kirwan addressing an OMERACT 10 plenary session.

Choosing Domains of Interest

What constitutes a “domain” is poorly defined. In this workshop3 the domain selection process of 3 OMERACT groups working on patient-reported outcomes (PRO) were examined in detail and used as a tool for thinking about the issues. There was agreement that a gold standard for domain selection would include 3 important aspects: following a framework; including the clinically relevant benefits and harms; and remaining true to the clinical question. The framework might be the International Classification of Functioning, Disability and Health (ICF)4, but many participants felt that this itself was incomplete. One possible reason may be that, in its current form, the ICF concentrates on the mechanistic disease process (see Figure 2, devised by J. Kirwan and A. Boonen during OMERACT 10). Quality of life includes aspects of an individual’s psychological status (such as their ability to self-manage their condition) and a person’s personal (environmental) resources that are available to help them manage their condition (such as their financial situation or the availability of supportive relatives), and these are less well captured. Including harms as well as benefits reflects the point made by Dworkin in his plenary address in the Virtual Campus workshop: clinical importance and therapeutic decisions about treatments are a balance between the two1. Finding which domains are relevant to the clinical question may require insight from both clinicians and patients. For example, the need to prevent the development and progression of erosions in rheumatoid arthritis is an outcome that would not be obvious to patients, whose experience is focused around the symptoms of inflammation.

Figure 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2.

Quality of life represented by 3 beams shining through: disease pathology and symptoms; psychological factors; and environmental challenges and support. At present, the International Classification of Functioning, Disability and Health (ICF) covers psychology and environment incompletely. ADL: activities of daily living.

Choosing or Developing Valid Instruments

“Choosing or developing instruments” looked closely at the notion of how an instrument (a questionnaire or a scale) to measure a PRO is developed and designed in the first place may have profound effects on its performance and appropriateness for outcome assessment in clinical trials5,6. The experience of many OMERACT groups, reported as illustrations within this broad discussion, showed that directly involving patients at the earliest stages of defining a domain and the effects that illness may have in that area will result in greater validity. The broader “life impact” of illness and its treatment needs to be considered7. Further, there was an emerging recognition that for complex interventions, where changes outside the immediate effects of a condition may allow adaptation or improved coping within that condition, some broader framework of outcome assessment may be needed8,9.

Taking the Domains and the Instruments sessions together, the notion of a different approach to looking at outcomes from interventions was mooted, and has subsequently been published10. This proposes an “impact triad” (incorporating severity, importance, and self-management; Figure 3) as a method of enhancing the measurement of the personal life impact of rheumatic diseases. It is represented by a triangle — as worn by the author in the picture. Further, these aspects of severity, importance, and self-management (or coping) may be broadly equated with symptoms, environment, and psychology, as shown in Figure 2. To measure only the impact of treatment designed to control disease severity might fail to capture important changes in self-management or the supportive environment, which may in fact be responsible for the improvement, or may hide some of the treatment benefits.

Figure 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 3.

The impact triad incorporating severity, importance, and self-management as 3 aspects of the overall impact of a condition on a patient. These aspects may be broadly equated with symptoms, psychology, and environment in Figure 2.

Calibrating the Changes Measured

How to describe to patients what benefits they might expect from a given intervention is difficult to do if only summary data on group mean changes are available. The way an instrument responds to change will determine if it is possible to offer patients a more clear understanding of what might happen to them personally if they take the treatment. This issue was explored in the workshop on response criteria and the importance of change11. When interpreting scores at the individual level, 4 main concepts need to be taken into account: improvement; status of well-being; onset of action; and sustainability. As the full report of that workshop proclaims — information from clinical trials on how many patients showed a response, what the level of response was, how quickly they improved, and how many patients are doing well over time, would be extremely useful — for patients and physicians alike11.

Plenary Summary

A summary of the plenary feedback from all 4 workshops, integrated and developed by further informal discussions between the workshop reporters, was presented to the final OMERACT plenary session for further consideration. It was evident that the main methodological issues were relevant to all those working on PRO, and there was a wish to see greater commitment to appropriate application of these methods. At the end of this final plenary session, participants were asked to vote on the proposal that: For OMERACT 11 we should collate (and provide evidence for) required principles and procedures for choosing domains, developing instruments, and specifying response criteria for PRO. This was approved by 92% of participants and will be taken forward as part of the development of version 2.0 of the OMERACT Filter.

Footnotes

  • P. Tugwell is supported in part by the Canadian Institutes of Health Research.

REFERENCES

  1. 1.↵
    1. Kirwan J,
    2. Boonen A,
    3. Harrison MJ,
    4. Hewlett S,
    5. Wells G,
    6. Singh JA,
    7. et al.
    OMERACT 10 Patient Perspective Virtual Campus: Valuing health; measuring outcomes in RA fatigue, RA sleep, arthroplasty, and systemic sclerosis; and the clinical significance of changes in health. J Rheumatol 2011;38:1728–34.
    OpenUrlAbstract/FREE Full Text
  2. 2.↵
    1. Boers M,
    2. Brooks P,
    3. Strand V,
    4. Tugwell P
    . The OMERACT Filter for outcome measures in rheumatology. J Rheumatol 1998;25:198–9.
    OpenUrlPubMed
  3. 3.↵
    1. Tugwell P,
    2. Petersson IF,
    3. Boers M,
    4. Gossec L,
    5. Kirwan J,
    6. Rader T,
    7. et al.
    Domains selection for patient-reported outcomes: Current activities and options for future methods. J Rheumatol 2011;38:1702–10.
    OpenUrlAbstract/FREE Full Text
  4. 4.↵
    1. World Health Organization
    . Towards a common language for functioning, disability and health. ICF. Geneva: World Health Organization; 2002. [Internet. Accessed April 12, 2011.] Available from: http://www.who.int/classifications/icf/training/icfbeginnersguide.pdf
  5. 5.↵
    1. Kirwan JR,
    2. Fries JF,
    3. Hewlett S,
    4. Osborne R
    . Patient perspective: Choosing or developing instruments. J Rheumatol 2011;38:1716–9.
    OpenUrlAbstract/FREE Full Text
  6. 6.↵
    1. Kirwan JR,
    2. Fries J,
    3. Hewlett S,
    4. Osborne RH,
    5. Newman S,
    6. Ciciriello S,
    7. et al.
    Patient Perspective Workshop: Moving towards OMERACT guidelines for choosing or developing instruments to measure patient reported outcomes. J Rheumatol 2011;38:1711–5.
    OpenUrlAbstract/FREE Full Text
  7. 7.↵
    1. Sanderson T,
    2. Kirwan J
    . Patient-reported outcomes for arthritis: time to focus on personal life impact measures? Arthritis Rheum 2009;61:1–3.
    OpenUrlPubMed
  8. 8.↵
    1. Craig P,
    2. Dieppe P,
    3. Macintyre S,
    4. Mitchie S,
    5. Nazareth I,
    6. Petticrew M
    . Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008;337:a1655.
    OpenUrlFREE Full Text
  9. 9.↵
    1. Anderson R
    . New MRC guidance on evaluating complex interventions. BMJ 2008;337:a1937.
    OpenUrlFREE Full Text
  10. 10.↵
    1. Sanderson T,
    2. Hewlett S,
    3. Flurey C,
    4. Dures E,
    5. Richards P,
    6. Kirwan J
    . The impact triad (incorporating severity, importance and self-management) as a method of enhancing the measurement of the personal life impact of rheumatic diseases. J Rheumatol 2011;38:191–4.
    OpenUrlFREE Full Text
  11. 11.↵
    1. Strand V,
    2. Boers M,
    3. Idzerda L,
    4. Kirwan JR,
    5. Kvien TK,
    6. Tugwell PS,
    7. et al.
    It’s good to feel better but it’s better to feel good and even better to feel good as soon as possible for as long as possible: Response criteria and the importance of change at OMERACT 10. J Rheumatol 2011;38:1720–7.
    OpenUrlAbstract/FREE Full Text
PreviousNext
Back to top

In this issue

The Journal of Rheumatology
Vol. 38, Issue 8
1 Aug 2011
  • Table of Contents
  • Table of Contents (PDF)
  • Index by Author
  • Editorial Board (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word about The Journal of Rheumatology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Overview of the Patient Perspective at OMERACT 10 — Conceptualizing Methods for Developing Patient-Reported Outcomes
(Your Name) has forwarded a page to you from The Journal of Rheumatology
(Your Name) thought you would like to see this page from the The Journal of Rheumatology web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Overview of the Patient Perspective at OMERACT 10 — Conceptualizing Methods for Developing Patient-Reported Outcomes
JOHN R. KIRWAN, PETER S. TUGWELL
The Journal of Rheumatology Aug 2011, 38 (8) 1699-1701; DOI: 10.3899/jrheum.110388

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero

 Request Permissions

Share
Overview of the Patient Perspective at OMERACT 10 — Conceptualizing Methods for Developing Patient-Reported Outcomes
JOHN R. KIRWAN, PETER S. TUGWELL
The Journal of Rheumatology Aug 2011, 38 (8) 1699-1701; DOI: 10.3899/jrheum.110388
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
    • Abstract
    • Choosing Domains of Interest
    • Choosing or Developing Valid Instruments
    • Calibrating the Changes Measured
    • Plenary Summary
    • Footnotes
    • REFERENCES
  • Figures & Data
  • References
  • Info & Metrics
  • PDF
  • eLetters

Related Articles

Cited By...

More in this TOC Section

OMERACT 10: 10th International Consensus Conference on Outcome Measures in Rheumatology, Kota Kinabalu, Borneo - May 4–8, 2010

  • Update on Research and Future Directions of the OMERACT MRI Inflammatory Arthritis Group
  • Patterns of Magnetic Resonance Imaging Bone Erosion in Rheumatoid Arthritis — Which Bones Are Most Frequently Involved and Show the Most Change?
  • Synovial Tissue Analysis for the Discovery of Diagnostic and Prognostic Biomarkers in Patients with Early Arthritis
Show more OMERACT 10: 10th International Consensus Conference on Outcome Measures in Rheumatology, Kota Kinabalu, Borneo - May 4–8, 2010

Patient-reported Outcomes

  • It's Good to Feel Better But It's Better To Feel Good and Even Better to Feel Good as Soon as Possible for as Long as Possible. Response Criteria and the Importance of Change at OMERACT 10
  • OMERACT 10 Patient Perspective Virtual Campus: Valuing Health; Measuring Outcomes in Rheumatoid Arthritis Fatigue, RA Sleep, Arthroplasty, and Systemic Sclerosis; and Clinical Significance of Changes in Health
  • Identifying Preliminary Domains to Detect and Measure Rheumatoid Arthritis Flares: Report of the OMERACT 10 RA Flare Workshop
Show more Patient-reported Outcomes

Similar Articles

Content

  • First Release
  • Current
  • Archives
  • Collections
  • Audiovisual Rheum
  • COVID-19 and Rheumatology

Resources

  • Guide for Authors
  • Submit Manuscript
  • Author Payment
  • Reviewers
  • Advertisers
  • Classified Ads
  • Reprints and Translations
  • Permissions
  • Meetings
  • FAQ
  • Policies

Subscribers

  • Subscription Information
  • Purchase Subscription
  • Your Account
  • Terms and Conditions

More

  • About Us
  • Contact Us
  • My Alerts
  • My Folders
  • Privacy/GDPR Policy
  • RSS Feeds
The Journal of Rheumatology
The content of this site is intended for health care professionals.
Copyright © 2022 by The Journal of Rheumatology Publishing Co. Ltd.
Print ISSN: 0315-162X; Online ISSN: 1499-2752
Powered by HighWire