- Split View
-
Views
-
Cite
Cite
A. V. Ramanan, R. Schneider, M. Batthish, C. Achonu, S. Ota, M. McLimont, N. L. Young, B. M. Feldman, Developing a disease activity tool for systemic-onset juvenile idiopathic arthritis by international consensus using the Delphi approach, Rheumatology, Volume 44, Issue 12, December 2005, Pages 1574–1578, https://doi.org/10.1093/rheumatology/kei095
- Share Icon Share
Abstract
Objectives. The systemic form of juvenile idiopathic arthritis may present with many diverse symptoms, signs and laboratory abnormalities. Our aim was to elicit and pool items useful for developing a consensus disease activity measure for systemic arthritis in children, using an international pool of respondents.
Methods. We used a Delphi survey process in two steps. First we surveyed 187 paediatric rheumatologists and allied health professionals. We elicited 2607 items that, when combined with previously elicited items from parents/patients, could be pooled into 107 independent items. We then surveyed the paediatric rheumatologists to determine the frequency and importance of the 107 items.
Results. Our response rate was 83% to both surveys. We identified 29 items as being the most important and most frequently seen indicators of active disease. The most highly rated of these items were: presence of fever, presence of rash, elevated ESR, elevated CRP, requirement for increasing medications, abnormal physician global evaluation and presence of joints with active arthritis.
Conclusions. Twenty-nine items are thought by medical practitioners to be most relevant in determining disease activity in systemic arthritis. As a next step, the measurement properties of these items will be tested to help develop a disease activity tool.
The systemic arthritis subtype of juvenile idiopathic arthritis (SJIA) is an important cause of morbidity and mortality among children with rheumatic diseases. Although it accounts for only 10–20% of all cases of juvenile idiopathic arthritis (JIA), it contributes to more than two-thirds of the mortality seen with JIA [1, 2]. Although a set of disease response measures has been developed for the other forms of juvenile idiopathic arthritis (JIA), this core set has been validated only for joint disease and not for the systemic disease manifestations of the systemic subtype of JIA (SJIA) [3]. The clinical diversity of manifestations—unique to SJIA—means that measures used in other forms of JIA are incapable of fully assessing disease activity in SJIA.
There are currently no measures of disease activity available for SJIA. The lack of standardized validated measures of disease activity has significantly limited the ability to measure the impact of this disease and to determine its response to therapeutic interventions. This may be one of the reasons for the lack of well-designed trials for assessing the efficacy of different therapies in SJIA.
The concepts of ‘disease activity’, ‘disease damage’ and ‘disease severity’ have not been well defined in the context of JIA. Currently there is no consensus among paediatric rheumatologists regarding the exact meaning of these terms. A commonly used definition of disease activity is ‘that component of severity that is reversible; activity may result in no or little damage in the future or be replaced completely by damage’ [4]. For our study, we defined disease activity as the reversible manifestations of SJIA.
Being able to quantify disease activity is important in the process of evaluating the efficacy of anti-inflammatory and remission-inducing treatments for arthritis; anti-arthritic treatments are aimed at reducing disease activity through their effects on the body's inflammatory pathways and immune system. Disease activity measures have already been developed for other adult and childhood rheumatic diseases, including dermatomyositis and systemic lupus erythematosus (SLE) [5–8].
Reducing disease activity is presumed to reduce future damage and therefore preserve quality of life. Indeed, the relationship between accumulated disease activity and disease damage has already been demonstrated in children with SLE [5, 6].
Our overall goal is to develop and validate a disease activity tool for SJIA. We plan to do this in several stages using a consensus approach. The tool is planned to include validated items that can be used to monitor disease and be used in future clinical trials. In contrast to other such attempts to develop disease activity tools, we decided to incorporate patient/parent perceptions of disease activity in the initial item generation phase of the process.
In our efforts to incorporate international opinion and consensus, we adopted the Delphi survey technique. The Delphi technique was developed by the Rand Corporation (and named after the famous oracle at Delphi). It has been widely used in health-care research [9–11]. According to Linstone, ‘Delphi may be characterized as a method for structuring a group communication process so that the process is effective in allowing a group of individuals as a whole to deal with a complex problem’ [12].
The specific aims of this project were to identify candidate items and to achieve reduction of the identified items to a manageable list using international consensus through the Delphi survey technique. This is a first step in the development of an eventual disease activity tool.
Materials and methods
A multistep process was designed to develop the disease activity tool for SJIA, as shown in Fig. 1. The specific steps of this phase of the project, which are addressed in this paper, are as follows: (i) we elicited items that reflect disease activity from physicians and allied health professionals, and from the parent and patient perspectives; (ii) we reduced the identified items to a manageable number; and (iii) we had physicians rank the reduced list of items for importance (items that are considered as being very reflective of disease activity) and frequency (items that are seen often in active disease).
Item generation
The first step of the process was to generate items that are thought to be important in measuring disease activity. For this we adopted a two-phase strategy of eliciting the opinions of physicians and allied health professionals. As a separate but allied project, candidate variables that represent disease activity were solicited from patients and parents of children with SJIA [13].
Phase 1
Item elicitation survey design. For both phases of the study, item elicitation surveys were designed using Dillman's tailored design method [14]. In accordance with the principles enunciated by Dillman, the following steps were taken to improve the response rate: a respondent-friendly survey was designed with easy-to-understand language; four contacts were made by first-class mail and e-mail, with an additional special contact by telephone or fax; return envelopes with postage stamps were included in the survey mail-out; correspondence was personalized; the survey was printed on off-white paper to help the surveys stand out on a crowded desk; and a small gift was sent in appreciation of the respondent's effort (but was not meant to remunerate for time spent).
Prior to mailing, this survey was pretested for readability, face validity (sensibility) and comprehensiveness by administering it to five rheumatologists and two allied health professionals at The Hospital for Sick Children. An evaluation form asked the seven respondents to rate the survey for the clarity of language, the appropriateness of the phrasing of the questions, the ease of completion, and the suggestion of any bias on the part of the researchers. The respondents of the evaluation were also asked to list any other issues with the survey. The survey was modified based on their feedback and comments.
The survey was open-ended in design. Respondents were asked to list the variables that, in their perception, were reflective of disease activity in SJIA. Suggested headings, used as prompts, included clinical symptoms, clinical signs, laboratory tests and radiological findings. The respondents were also asked about how many individual patients with SJIA were seen in their centre every year.
The surveys were mailed initially. In order to increase response rate, a postal reminder was sent 2 weeks later, followed by mailing of the entire survey again in 4 weeks’ time. A personalized e-mail was sent at 6 weeks along with the survey attached to the e-mail. As a final step, the non-respondents were contacted personally by one of the investigators to solicit their participation.
Study respondents: physicians. Surveys were sent to paediatric rheumatologists internationally. In order to be objective and to avoid any potential bias, the heads of paediatric rheumatology organizations were asked to nominate individuals with expertise in SJIA; the physicians sampled were nominated by the heads of these organizations. The organizations were PRINTO (Pediatric Rheumatology International Trials Organization), PRCSG (Pediatric Rheumatology Collaborative Study Group), PRES (Pediatric Rheumatology European Society), BPRG (British Paediatric Rheumatology Group) and CPRA (Canadian Pediatric Rheumatology Association). Not all organizations were represented equally, as many respondents belonged to more than one of these groups. A total of 171 paediatric rheumatologists worldwide were sent the surveys.
Study respondents: allied health professionals. Sixteen allied health professionals were also sent the survey (therefore the total sample size for Phase I was 187). They were nominated by the head of the ARHP (Association of Rheumatology Health Professionals) for their expertise in paediatric rheumatic diseases.
As a separate study, parents and children with SJIA were interviewed for their input regarding disease activity. The parents and patients were chosen by purposive sampling to reflect the mixture of age, sex and disease severity seen with SJIA [13].
Phase 2
Item reduction. The 2607 items generated from the first phase were reduced to 107 by combining like items. This process was done by the investigators. All items elicited from the family interviews were included at this stage. Three of the investigators (A.V.R., R.S., B.M.F.) initially organized the 2607 items independently. They then met on two occasions to collectively compare the categories created and to establish consensus where there were differences in opinion about the individual categories. All the final items were decided based on complete consensus of the three investigators.
A second questionnaire containing these 107 items was designed asking respondents to rank each item for its importance and frequency on a five-point categorical scale. The questionnaire was again designed using Dillman's tailored design method. The respondents were also given a column alongside each item to list any comments they may have had on that item. At the end of the questionnaire the respondents were asked to list any items that may have been missed out from the initial phases that were considered by them to be important.
Prior to mailing, this second questionnaire was pretested for readability, face validity (sensibility) and comprehensiveness by administering it to five rheumatologists at The Hospital for Sick Children. The questionnaire was modified, based on their feedback and comments in an evaluation form, using a process similar to the first survey development.
The questionnaires were sent to the respondents by both e-mail and by post initially. In order to increase response rate, a postal reminder was sent 2 weeks later, followed by mailing of the entire questionnaire again in 4 weeks’ time. A personalized e-mail was sent at 6 weeks along with the questionnaire attached to the e-mail.
Physicians. One hundred and sixty-nine physicians who participated in the initial phase were sent the Phase 2 questionnaire (two of the original participants declined to participate in the future phases).
Data entry. Double data entry of all questionnaires was done to ensure accuracy of data.
The project was approved by the Research Ethics Board of The Hospital for Sick Children.
Results
In phase 1, the overall response rate was 155/187 (83%). The respondents were quite experienced: on average they saw 23 patients with SJIA yearly (minimum 1, maximum 120). The response from the different organizations is shown in Table 1. A total of 2607 items were generated from the first phase of the study. The patient and parent interviews elicited 110 items [15].
Organization . | Phase 1 response rate 83% (155/187) . | Phase 2 response rate 83% (140/169) . |
---|---|---|
Pediatric Rheumatology European Society (PRES) | 75% (3/4) | 100% (4/4) |
Canadian Pediatric Rheumatology Association (CPRA) | 88% (23/26) | 83% (20/24) |
Pediatric Rheumatology Collaborative Study Group (PRCSG) | 78% (73/93) | 81% (75/93) |
British Paediatric Rheumatology Group (BPRG) | 100% (8/8) | 100% (8/8) |
Pediatric Rheumatology International Trials Organization (PRINTO) | 90% (36/40) | 83% (33/40) |
Association of Rheumatology Health Professionals (ARHP) | 75% (12/16) | N/A |
Organization . | Phase 1 response rate 83% (155/187) . | Phase 2 response rate 83% (140/169) . |
---|---|---|
Pediatric Rheumatology European Society (PRES) | 75% (3/4) | 100% (4/4) |
Canadian Pediatric Rheumatology Association (CPRA) | 88% (23/26) | 83% (20/24) |
Pediatric Rheumatology Collaborative Study Group (PRCSG) | 78% (73/93) | 81% (75/93) |
British Paediatric Rheumatology Group (BPRG) | 100% (8/8) | 100% (8/8) |
Pediatric Rheumatology International Trials Organization (PRINTO) | 90% (36/40) | 83% (33/40) |
Association of Rheumatology Health Professionals (ARHP) | 75% (12/16) | N/A |
Phase I: 187 surveys mailed, 155 respondents (7 declined participation, 148 completed surveys). Phase 2: 169 surveys mailed, 140 respondents (6 declined participation, 134 completed surveys). N/A, not applicable.
Organization . | Phase 1 response rate 83% (155/187) . | Phase 2 response rate 83% (140/169) . |
---|---|---|
Pediatric Rheumatology European Society (PRES) | 75% (3/4) | 100% (4/4) |
Canadian Pediatric Rheumatology Association (CPRA) | 88% (23/26) | 83% (20/24) |
Pediatric Rheumatology Collaborative Study Group (PRCSG) | 78% (73/93) | 81% (75/93) |
British Paediatric Rheumatology Group (BPRG) | 100% (8/8) | 100% (8/8) |
Pediatric Rheumatology International Trials Organization (PRINTO) | 90% (36/40) | 83% (33/40) |
Association of Rheumatology Health Professionals (ARHP) | 75% (12/16) | N/A |
Organization . | Phase 1 response rate 83% (155/187) . | Phase 2 response rate 83% (140/169) . |
---|---|---|
Pediatric Rheumatology European Society (PRES) | 75% (3/4) | 100% (4/4) |
Canadian Pediatric Rheumatology Association (CPRA) | 88% (23/26) | 83% (20/24) |
Pediatric Rheumatology Collaborative Study Group (PRCSG) | 78% (73/93) | 81% (75/93) |
British Paediatric Rheumatology Group (BPRG) | 100% (8/8) | 100% (8/8) |
Pediatric Rheumatology International Trials Organization (PRINTO) | 90% (36/40) | 83% (33/40) |
Association of Rheumatology Health Professionals (ARHP) | 75% (12/16) | N/A |
Phase I: 187 surveys mailed, 155 respondents (7 declined participation, 148 completed surveys). Phase 2: 169 surveys mailed, 140 respondents (6 declined participation, 134 completed surveys). N/A, not applicable.
The response rate of the second phase was 140/169 (83%). The response rate from the different organizations is shown in Table 1.
The items that scored a maximum of 5 on the importance scale (i.e. items thought to be the most important indicators of active SJIA) were fever, rash, increased erythrocyte sedimentation rate (ESR), increased C-reactive protein (CRP), requirement for increasing medications, inability to taper off medications, abnormal physician global evaluation of disease activity, and joints with active arthritis.
The items that were thought to be seen most often as indicators of active SJIA (i.e. the most frequent items) were fever, rash, increased ESR, increased CRP, requirement for increasing medications, abnormal physician global evaluation disease activity, abnormal parent evaluation of disease activity, joints with active arthritis, morning stiffness, joint pain, fatigue, thrombocytosis, leucocytosis and anaemia.
For the 107 items, the median score of 14 items was 5 on the importance scale (most important), 33 items scored 4, one item scored 3.5, 35 items scored 3, one item scored 2.5, 18 items scored 2 and five items scored 1 (least important). On the frequency rating of the 107 items, the median score of 14 items was 5 (most frequently seen), 26 items scored 4, 28 items scored 3, 26 items scored 2 and 13 items scored 1 (least frequently seen) (see Appendix 1 for the list of 107 items and the median importance and median frequency).
The top 29 items from this phase are listed in Table 2. All the top 29 items had a median score of 4 or more on both the importance and frequency ratings (where 1 indicates little importance and 5 is very important; 1 indicates very infrequent and 5 very frequent). These 29 items will form the basis of a tool to be validated in future studies in patients.
Top items . | Median importance . | Median frequency . |
---|---|---|
Fever | 5 | 5 |
Rash | 5 | 5 |
Increased ESR | 5 | 5 |
Increased CRP | 5 | 5 |
Requirements for increasing medications | 5 | 5 |
Inability to taper off medications | 5 | 4 |
Abnormal physician global evaluation of disease activity | 5 | 5 |
Joints with active arthritis | 5 | 5 |
Swollen joints | 5 | 4 |
Morning stiffness | 4 | 5 |
Joint pain | 4 | 5 |
Tender joints | 4 | 4 |
Synovitis/joint effusion on MRI | 4 | 4 |
Joints with decreased range of movement | 4 | 4 |
Abnormal parent evaluation of disease activity | 4 | 5 |
Abnormal patient global assessment of disease | 4 | 4 |
Thrombocytosis | 4 | 5 |
Leucocytosis | 4 | 5 |
Neutrophilia | 4 | 4 |
Anaemia | 4 | 5 |
Increased ferritin | 4 | 4 |
Splenomegaly | 4 | 4 |
Lymphadenopathy | 4 | 4 |
Hepatomegaly | 4 | 4 |
Reduction of height velocity | 4 | 4 |
Increased global measure of pain | 4 | 4 |
Decreased QOL measure | 4 | 4 |
Decrease in physical activity level | 4 | 4 |
Abnormal physical function | 4 | 4 |
Top items . | Median importance . | Median frequency . |
---|---|---|
Fever | 5 | 5 |
Rash | 5 | 5 |
Increased ESR | 5 | 5 |
Increased CRP | 5 | 5 |
Requirements for increasing medications | 5 | 5 |
Inability to taper off medications | 5 | 4 |
Abnormal physician global evaluation of disease activity | 5 | 5 |
Joints with active arthritis | 5 | 5 |
Swollen joints | 5 | 4 |
Morning stiffness | 4 | 5 |
Joint pain | 4 | 5 |
Tender joints | 4 | 4 |
Synovitis/joint effusion on MRI | 4 | 4 |
Joints with decreased range of movement | 4 | 4 |
Abnormal parent evaluation of disease activity | 4 | 5 |
Abnormal patient global assessment of disease | 4 | 4 |
Thrombocytosis | 4 | 5 |
Leucocytosis | 4 | 5 |
Neutrophilia | 4 | 4 |
Anaemia | 4 | 5 |
Increased ferritin | 4 | 4 |
Splenomegaly | 4 | 4 |
Lymphadenopathy | 4 | 4 |
Hepatomegaly | 4 | 4 |
Reduction of height velocity | 4 | 4 |
Increased global measure of pain | 4 | 4 |
Decreased QOL measure | 4 | 4 |
Decrease in physical activity level | 4 | 4 |
Abnormal physical function | 4 | 4 |
Top items . | Median importance . | Median frequency . |
---|---|---|
Fever | 5 | 5 |
Rash | 5 | 5 |
Increased ESR | 5 | 5 |
Increased CRP | 5 | 5 |
Requirements for increasing medications | 5 | 5 |
Inability to taper off medications | 5 | 4 |
Abnormal physician global evaluation of disease activity | 5 | 5 |
Joints with active arthritis | 5 | 5 |
Swollen joints | 5 | 4 |
Morning stiffness | 4 | 5 |
Joint pain | 4 | 5 |
Tender joints | 4 | 4 |
Synovitis/joint effusion on MRI | 4 | 4 |
Joints with decreased range of movement | 4 | 4 |
Abnormal parent evaluation of disease activity | 4 | 5 |
Abnormal patient global assessment of disease | 4 | 4 |
Thrombocytosis | 4 | 5 |
Leucocytosis | 4 | 5 |
Neutrophilia | 4 | 4 |
Anaemia | 4 | 5 |
Increased ferritin | 4 | 4 |
Splenomegaly | 4 | 4 |
Lymphadenopathy | 4 | 4 |
Hepatomegaly | 4 | 4 |
Reduction of height velocity | 4 | 4 |
Increased global measure of pain | 4 | 4 |
Decreased QOL measure | 4 | 4 |
Decrease in physical activity level | 4 | 4 |
Abnormal physical function | 4 | 4 |
Top items . | Median importance . | Median frequency . |
---|---|---|
Fever | 5 | 5 |
Rash | 5 | 5 |
Increased ESR | 5 | 5 |
Increased CRP | 5 | 5 |
Requirements for increasing medications | 5 | 5 |
Inability to taper off medications | 5 | 4 |
Abnormal physician global evaluation of disease activity | 5 | 5 |
Joints with active arthritis | 5 | 5 |
Swollen joints | 5 | 4 |
Morning stiffness | 4 | 5 |
Joint pain | 4 | 5 |
Tender joints | 4 | 4 |
Synovitis/joint effusion on MRI | 4 | 4 |
Joints with decreased range of movement | 4 | 4 |
Abnormal parent evaluation of disease activity | 4 | 5 |
Abnormal patient global assessment of disease | 4 | 4 |
Thrombocytosis | 4 | 5 |
Leucocytosis | 4 | 5 |
Neutrophilia | 4 | 4 |
Anaemia | 4 | 5 |
Increased ferritin | 4 | 4 |
Splenomegaly | 4 | 4 |
Lymphadenopathy | 4 | 4 |
Hepatomegaly | 4 | 4 |
Reduction of height velocity | 4 | 4 |
Increased global measure of pain | 4 | 4 |
Decreased QOL measure | 4 | 4 |
Decrease in physical activity level | 4 | 4 |
Abnormal physical function | 4 | 4 |
Discussion
Using a consensus technique, we determined the frequency and importance of all the 170 discrete indicators of disease activity for children with SJIA that were suggested by a survey of expert paediatric rheumatologists worldwide. Of these 170 indicators, 29 were scored the most frequent and important and are candidates to be part of a final index of disease activity for this disease.
The items found to be important and frequently seen in SJIA fit naturally into domains: systemic symptoms (fever, rash, splenomegaly, lymphadenopathy), inflammatory markers (raised ESR and CRP), joint manifestations (joints with active arthritis, swollen joint count, morning stiffness, joint pain), functional measures, quality of life (QOL) measures, physician's global and parent's/patient's global assessment of disease activity.
Items that were thought to be significant but not found in the eventual list include pericarditis, myocarditis, Koebner phenomenon, weight loss, sore throat and features of macrophage activation syndrome. Some of these, such as pericarditis and myocarditis, were thought to be important but not frequently seen. Some items (weight loss, fatigue) were thought to be frequently seen but not important (perhaps because of poor specificity) as indicators of active disease. Overall, we feel our respondents understood the purpose of the exercise as being to come up with a ‘core’ selection of items for a disease activity tool that could be easily and widely used.
We used the Delphi process in our attempt to develop a disease activity tool. The Delphi technique enabled us to elicit opinions (items) from a diverse group of paediatric rheumatologists in an anonymous fashion. This process allowed us to get high-quality ideas from an international group of participants; this should allow the eventual tool to have broad acceptance.
In order to ensure patient/parent input, the initial phase included items generated from an interview with 14 patients/parents chosen by purposive sampling to be representative of age, gender, disease activity and disease severity. We feel that our method of including allied health professionals and patients/parents in the initial phases broadened the perspective and allowed us to include all potentially important indicators of disease activity.
There was a high response rate from both phases of our surveys. Consequently, we feel that our survey respondents were representative of paediatric rheumatologists internationally.
One of the potential disadvantages of the Delphi technique is the lack of a uniform standardized methodology. There are several differing forms of Delphi described in the literature, including the ‘modified Delphi’, the ‘policy Delphi’ and the ‘real-time Delphi’ [16–18]. Due to the flexibility of the technique, a frequent criticism is lack of methodological rigour. However, we feel that this flexibility was an intrinsic advantage as it enabled us to elicit a wide variety of responses from individuals without any peer interference. Regardless of the type of Delphi format used, the appropriate use of this technique requires a high degree of methodological precision, which we adhered to.
The other major criticism of the Delphi approach is that, since achieving consensus is a primary aim, there is a danger that possibly important variations in views will be concealed. Some experts have argued that ‘considering that there is a strong natural tendency in the Delphi for opinion to centralize, resistance in the form of un-consensual distribution should be viewed with special interest’ [17]. It is possible that the items that we have selected are not, in some way, the best disease activity indicators; however, given the strong consensus, they represent the most widely held beliefs in the paediatric rheumatology community.
As the next step in the development of a disease activity tool, we plan to validate the current list of 29 items in a series of SJIA patients and determine the psychometric properties of each item. We have operationalized these items by formulating a preliminary working definition and scaling method for each; these definitions will be tested in the SJIA patient series. A final consensus phase will determine the best and most parsimonious list of items that can be used to determine disease activity in SJIA.
Appendix 1
Top items . | Median importance . | Median frequency . |
---|---|---|
Fever | 5 | 5 |
Rash | 5 | 5 |
Increased ESR | 5 | 5 |
Increased CRP | 5 | 5 |
Requirements for increasing medications | 5 | 5 |
Inability to taper off medications | 5 | 4 |
Abnormal physician global evaluation of disease activity | 5 | 5 |
Joints with active arthritis | 5 | 5 |
Swollen joints | 5 | 4 |
Morning stiffness | 4 | 5 |
Joint pain | 4 | 5 |
Tender joints | 4 | 4 |
Synovitis/joint effusion on MRI | 4 | 4 |
Joints with decreased range of movement | 4 | 4 |
Abnormal parent evaluation of disease activity | 4 | 5 |
Thrombocytosis | 4 | 5 |
Leucocytosis | 4 | 5 |
Neutrophilia | 4 | 4 |
Anaemia | 4 | 5 |
Increased ferritin | 4 | 4 |
Splenomegaly | 4 | 4 |
Lymphadenopathy | 4 | 4 |
Hepatomegaly | 4 | 4 |
Reduction of height velocity | 4 | 4 |
Increased global measure of pain | 4 | 4 |
Decreased QOL measure | 4 | 4 |
Decrease in physical activity level | 4 | 4 |
Abnormal physical function | 4 | 4 |
Signs of pericarditis | 5 | 3 |
Progressive X-ray change in joint | 5 | 3 |
Imaging studies of pericarditis | 5 | 3 |
Myocarditis | 5 | 2 |
Features of macrophage activation syndrome | 5 | 2 |
Abnormal patient global assessment of disease | 4 | 4 |
X-ray bone erosions | 4 | 3 |
Weight loss | 4 | 3 |
Symptoms of pericarditis | 4 | 3 |
Rapidly decreasing physical function | 4 | 3 |
Increased difficulty walking/climbing stairs | 4 | 3 |
Symptoms of pleuritis | 4 | 2 |
Symptoms of peritonitis | 4 | 2 |
Signs of pleuritis | 4 | 2 |
Signs of peritonitis | 4 | 2 |
Imaging studies demonstrating pleuritis | 4 | 2 |
Abnormal ECG | 3.5 | 2 |
Vasculitis | 4 | 1 |
Imaging studies of peritonitis | 4 | 1 |
Heart valve inflammation | 4 | 1 |
Fatigue | 3 | 5 |
Tachycardia | 3 | 4 |
Synovitis/joint effusion on ultrasonography | 3 | 4 |
Osteopenia | 3 | 4 |
Low MCV | 3 | 4 |
Joint warmth | 3 | 4 |
Increased fibrinogen | 3 | 4 |
Hypoalbuminaemia | 3 | 4 |
Anorexia | 3 | 4 |
Weakness | 3 | 3 |
Rigors/shakes/chills | 3 | 3 |
Poor school attendance | 3 | 3 |
Neck stiffness | 3 | 3 |
Myalgia | 3 | 3 |
Muscle wasting | 3 | 3 |
Koebner phenomenon | 3 | 3 |
Increased transaminases | 3 | 3 |
Increase in mood disturbances | 3 | 3 |
Increase in lactate dehydrogenase | 3 | 3 |
Difficulty writing | 3 | 3 |
Deterioration in school performance | 3 | 3 |
Delay in sexual development | 3 | 3 |
Decrease in social functioning | 3 | 3 |
Change in level of independence | 3 | 3 |
Bursitis, tenosynovitis | 3 | 3 |
Tachypnoea | 3 | 2 |
Synovial cysts | 3 | 2 |
Myositis | 3 | 2 |
Joint erythema | 3 | 2 |
Increased PT/PTT | 3 | 2 |
Increased fibrin degradation | 3 | 2 |
Increased d-dimer | 3 | 2 |
Hypertriglyceridaemia | 3 | 2 |
Renal involvement | 3 | 1 |
Pneumonitis | 3 | 1 |
Increased immunoglobulins | 2 | 4 |
Increased complement | 2 | 4 |
Synovitis on bone scan | 2 | 3 |
Increased IL-6 | 2 | 3 |
Increased α2-globulin | 2 | 3 |
Abnormal sleep pattern | 2 | 3 |
Vomiting | 2 | 2 |
Sweating | 2 | 2 |
Sore throat | 2 | 2 |
Pruritis | 2 | 2 |
Mucositis | 2 | 2 |
Increased SAA | 2 | 2 |
Hypersensitivity to external stimuli | 2 | 2 |
Headache | 2 | 2 |
Abdominal pain | 2 | 2 |
Proteinuria | 2.5 | 1 |
Inflammatory eye disease | 2 | 1 |
Haemoptysis | 2 | 1 |
Alopecia | 2 | 1 |
Increased immune complexes | 1 | 2 |
Increased TNF | 1 | 1 |
Dysuria | 1 | 1 |
Diarrhoea | 1 | 1 |
Constipation | 1 | 1 |
Top items . | Median importance . | Median frequency . |
---|---|---|
Fever | 5 | 5 |
Rash | 5 | 5 |
Increased ESR | 5 | 5 |
Increased CRP | 5 | 5 |
Requirements for increasing medications | 5 | 5 |
Inability to taper off medications | 5 | 4 |
Abnormal physician global evaluation of disease activity | 5 | 5 |
Joints with active arthritis | 5 | 5 |
Swollen joints | 5 | 4 |
Morning stiffness | 4 | 5 |
Joint pain | 4 | 5 |
Tender joints | 4 | 4 |
Synovitis/joint effusion on MRI | 4 | 4 |
Joints with decreased range of movement | 4 | 4 |
Abnormal parent evaluation of disease activity | 4 | 5 |
Thrombocytosis | 4 | 5 |
Leucocytosis | 4 | 5 |
Neutrophilia | 4 | 4 |
Anaemia | 4 | 5 |
Increased ferritin | 4 | 4 |
Splenomegaly | 4 | 4 |
Lymphadenopathy | 4 | 4 |
Hepatomegaly | 4 | 4 |
Reduction of height velocity | 4 | 4 |
Increased global measure of pain | 4 | 4 |
Decreased QOL measure | 4 | 4 |
Decrease in physical activity level | 4 | 4 |
Abnormal physical function | 4 | 4 |
Signs of pericarditis | 5 | 3 |
Progressive X-ray change in joint | 5 | 3 |
Imaging studies of pericarditis | 5 | 3 |
Myocarditis | 5 | 2 |
Features of macrophage activation syndrome | 5 | 2 |
Abnormal patient global assessment of disease | 4 | 4 |
X-ray bone erosions | 4 | 3 |
Weight loss | 4 | 3 |
Symptoms of pericarditis | 4 | 3 |
Rapidly decreasing physical function | 4 | 3 |
Increased difficulty walking/climbing stairs | 4 | 3 |
Symptoms of pleuritis | 4 | 2 |
Symptoms of peritonitis | 4 | 2 |
Signs of pleuritis | 4 | 2 |
Signs of peritonitis | 4 | 2 |
Imaging studies demonstrating pleuritis | 4 | 2 |
Abnormal ECG | 3.5 | 2 |
Vasculitis | 4 | 1 |
Imaging studies of peritonitis | 4 | 1 |
Heart valve inflammation | 4 | 1 |
Fatigue | 3 | 5 |
Tachycardia | 3 | 4 |
Synovitis/joint effusion on ultrasonography | 3 | 4 |
Osteopenia | 3 | 4 |
Low MCV | 3 | 4 |
Joint warmth | 3 | 4 |
Increased fibrinogen | 3 | 4 |
Hypoalbuminaemia | 3 | 4 |
Anorexia | 3 | 4 |
Weakness | 3 | 3 |
Rigors/shakes/chills | 3 | 3 |
Poor school attendance | 3 | 3 |
Neck stiffness | 3 | 3 |
Myalgia | 3 | 3 |
Muscle wasting | 3 | 3 |
Koebner phenomenon | 3 | 3 |
Increased transaminases | 3 | 3 |
Increase in mood disturbances | 3 | 3 |
Increase in lactate dehydrogenase | 3 | 3 |
Difficulty writing | 3 | 3 |
Deterioration in school performance | 3 | 3 |
Delay in sexual development | 3 | 3 |
Decrease in social functioning | 3 | 3 |
Change in level of independence | 3 | 3 |
Bursitis, tenosynovitis | 3 | 3 |
Tachypnoea | 3 | 2 |
Synovial cysts | 3 | 2 |
Myositis | 3 | 2 |
Joint erythema | 3 | 2 |
Increased PT/PTT | 3 | 2 |
Increased fibrin degradation | 3 | 2 |
Increased d-dimer | 3 | 2 |
Hypertriglyceridaemia | 3 | 2 |
Renal involvement | 3 | 1 |
Pneumonitis | 3 | 1 |
Increased immunoglobulins | 2 | 4 |
Increased complement | 2 | 4 |
Synovitis on bone scan | 2 | 3 |
Increased IL-6 | 2 | 3 |
Increased α2-globulin | 2 | 3 |
Abnormal sleep pattern | 2 | 3 |
Vomiting | 2 | 2 |
Sweating | 2 | 2 |
Sore throat | 2 | 2 |
Pruritis | 2 | 2 |
Mucositis | 2 | 2 |
Increased SAA | 2 | 2 |
Hypersensitivity to external stimuli | 2 | 2 |
Headache | 2 | 2 |
Abdominal pain | 2 | 2 |
Proteinuria | 2.5 | 1 |
Inflammatory eye disease | 2 | 1 |
Haemoptysis | 2 | 1 |
Alopecia | 2 | 1 |
Increased immune complexes | 1 | 2 |
Increased TNF | 1 | 1 |
Dysuria | 1 | 1 |
Diarrhoea | 1 | 1 |
Constipation | 1 | 1 |
PT, prothrombin time; PTT, partial thromboplastin time; MCV, mean corpuscular time; SAA, serum amyloid A protein.
Top items . | Median importance . | Median frequency . |
---|---|---|
Fever | 5 | 5 |
Rash | 5 | 5 |
Increased ESR | 5 | 5 |
Increased CRP | 5 | 5 |
Requirements for increasing medications | 5 | 5 |
Inability to taper off medications | 5 | 4 |
Abnormal physician global evaluation of disease activity | 5 | 5 |
Joints with active arthritis | 5 | 5 |
Swollen joints | 5 | 4 |
Morning stiffness | 4 | 5 |
Joint pain | 4 | 5 |
Tender joints | 4 | 4 |
Synovitis/joint effusion on MRI | 4 | 4 |
Joints with decreased range of movement | 4 | 4 |
Abnormal parent evaluation of disease activity | 4 | 5 |
Thrombocytosis | 4 | 5 |
Leucocytosis | 4 | 5 |
Neutrophilia | 4 | 4 |
Anaemia | 4 | 5 |
Increased ferritin | 4 | 4 |
Splenomegaly | 4 | 4 |
Lymphadenopathy | 4 | 4 |
Hepatomegaly | 4 | 4 |
Reduction of height velocity | 4 | 4 |
Increased global measure of pain | 4 | 4 |
Decreased QOL measure | 4 | 4 |
Decrease in physical activity level | 4 | 4 |
Abnormal physical function | 4 | 4 |
Signs of pericarditis | 5 | 3 |
Progressive X-ray change in joint | 5 | 3 |
Imaging studies of pericarditis | 5 | 3 |
Myocarditis | 5 | 2 |
Features of macrophage activation syndrome | 5 | 2 |
Abnormal patient global assessment of disease | 4 | 4 |
X-ray bone erosions | 4 | 3 |
Weight loss | 4 | 3 |
Symptoms of pericarditis | 4 | 3 |
Rapidly decreasing physical function | 4 | 3 |
Increased difficulty walking/climbing stairs | 4 | 3 |
Symptoms of pleuritis | 4 | 2 |
Symptoms of peritonitis | 4 | 2 |
Signs of pleuritis | 4 | 2 |
Signs of peritonitis | 4 | 2 |
Imaging studies demonstrating pleuritis | 4 | 2 |
Abnormal ECG | 3.5 | 2 |
Vasculitis | 4 | 1 |
Imaging studies of peritonitis | 4 | 1 |
Heart valve inflammation | 4 | 1 |
Fatigue | 3 | 5 |
Tachycardia | 3 | 4 |
Synovitis/joint effusion on ultrasonography | 3 | 4 |
Osteopenia | 3 | 4 |
Low MCV | 3 | 4 |
Joint warmth | 3 | 4 |
Increased fibrinogen | 3 | 4 |
Hypoalbuminaemia | 3 | 4 |
Anorexia | 3 | 4 |
Weakness | 3 | 3 |
Rigors/shakes/chills | 3 | 3 |
Poor school attendance | 3 | 3 |
Neck stiffness | 3 | 3 |
Myalgia | 3 | 3 |
Muscle wasting | 3 | 3 |
Koebner phenomenon | 3 | 3 |
Increased transaminases | 3 | 3 |
Increase in mood disturbances | 3 | 3 |
Increase in lactate dehydrogenase | 3 | 3 |
Difficulty writing | 3 | 3 |
Deterioration in school performance | 3 | 3 |
Delay in sexual development | 3 | 3 |
Decrease in social functioning | 3 | 3 |
Change in level of independence | 3 | 3 |
Bursitis, tenosynovitis | 3 | 3 |
Tachypnoea | 3 | 2 |
Synovial cysts | 3 | 2 |
Myositis | 3 | 2 |
Joint erythema | 3 | 2 |
Increased PT/PTT | 3 | 2 |
Increased fibrin degradation | 3 | 2 |
Increased d-dimer | 3 | 2 |
Hypertriglyceridaemia | 3 | 2 |
Renal involvement | 3 | 1 |
Pneumonitis | 3 | 1 |
Increased immunoglobulins | 2 | 4 |
Increased complement | 2 | 4 |
Synovitis on bone scan | 2 | 3 |
Increased IL-6 | 2 | 3 |
Increased α2-globulin | 2 | 3 |
Abnormal sleep pattern | 2 | 3 |
Vomiting | 2 | 2 |
Sweating | 2 | 2 |
Sore throat | 2 | 2 |
Pruritis | 2 | 2 |
Mucositis | 2 | 2 |
Increased SAA | 2 | 2 |
Hypersensitivity to external stimuli | 2 | 2 |
Headache | 2 | 2 |
Abdominal pain | 2 | 2 |
Proteinuria | 2.5 | 1 |
Inflammatory eye disease | 2 | 1 |
Haemoptysis | 2 | 1 |
Alopecia | 2 | 1 |
Increased immune complexes | 1 | 2 |
Increased TNF | 1 | 1 |
Dysuria | 1 | 1 |
Diarrhoea | 1 | 1 |
Constipation | 1 | 1 |
Top items . | Median importance . | Median frequency . |
---|---|---|
Fever | 5 | 5 |
Rash | 5 | 5 |
Increased ESR | 5 | 5 |
Increased CRP | 5 | 5 |
Requirements for increasing medications | 5 | 5 |
Inability to taper off medications | 5 | 4 |
Abnormal physician global evaluation of disease activity | 5 | 5 |
Joints with active arthritis | 5 | 5 |
Swollen joints | 5 | 4 |
Morning stiffness | 4 | 5 |
Joint pain | 4 | 5 |
Tender joints | 4 | 4 |
Synovitis/joint effusion on MRI | 4 | 4 |
Joints with decreased range of movement | 4 | 4 |
Abnormal parent evaluation of disease activity | 4 | 5 |
Thrombocytosis | 4 | 5 |
Leucocytosis | 4 | 5 |
Neutrophilia | 4 | 4 |
Anaemia | 4 | 5 |
Increased ferritin | 4 | 4 |
Splenomegaly | 4 | 4 |
Lymphadenopathy | 4 | 4 |
Hepatomegaly | 4 | 4 |
Reduction of height velocity | 4 | 4 |
Increased global measure of pain | 4 | 4 |
Decreased QOL measure | 4 | 4 |
Decrease in physical activity level | 4 | 4 |
Abnormal physical function | 4 | 4 |
Signs of pericarditis | 5 | 3 |
Progressive X-ray change in joint | 5 | 3 |
Imaging studies of pericarditis | 5 | 3 |
Myocarditis | 5 | 2 |
Features of macrophage activation syndrome | 5 | 2 |
Abnormal patient global assessment of disease | 4 | 4 |
X-ray bone erosions | 4 | 3 |
Weight loss | 4 | 3 |
Symptoms of pericarditis | 4 | 3 |
Rapidly decreasing physical function | 4 | 3 |
Increased difficulty walking/climbing stairs | 4 | 3 |
Symptoms of pleuritis | 4 | 2 |
Symptoms of peritonitis | 4 | 2 |
Signs of pleuritis | 4 | 2 |
Signs of peritonitis | 4 | 2 |
Imaging studies demonstrating pleuritis | 4 | 2 |
Abnormal ECG | 3.5 | 2 |
Vasculitis | 4 | 1 |
Imaging studies of peritonitis | 4 | 1 |
Heart valve inflammation | 4 | 1 |
Fatigue | 3 | 5 |
Tachycardia | 3 | 4 |
Synovitis/joint effusion on ultrasonography | 3 | 4 |
Osteopenia | 3 | 4 |
Low MCV | 3 | 4 |
Joint warmth | 3 | 4 |
Increased fibrinogen | 3 | 4 |
Hypoalbuminaemia | 3 | 4 |
Anorexia | 3 | 4 |
Weakness | 3 | 3 |
Rigors/shakes/chills | 3 | 3 |
Poor school attendance | 3 | 3 |
Neck stiffness | 3 | 3 |
Myalgia | 3 | 3 |
Muscle wasting | 3 | 3 |
Koebner phenomenon | 3 | 3 |
Increased transaminases | 3 | 3 |
Increase in mood disturbances | 3 | 3 |
Increase in lactate dehydrogenase | 3 | 3 |
Difficulty writing | 3 | 3 |
Deterioration in school performance | 3 | 3 |
Delay in sexual development | 3 | 3 |
Decrease in social functioning | 3 | 3 |
Change in level of independence | 3 | 3 |
Bursitis, tenosynovitis | 3 | 3 |
Tachypnoea | 3 | 2 |
Synovial cysts | 3 | 2 |
Myositis | 3 | 2 |
Joint erythema | 3 | 2 |
Increased PT/PTT | 3 | 2 |
Increased fibrin degradation | 3 | 2 |
Increased d-dimer | 3 | 2 |
Hypertriglyceridaemia | 3 | 2 |
Renal involvement | 3 | 1 |
Pneumonitis | 3 | 1 |
Increased immunoglobulins | 2 | 4 |
Increased complement | 2 | 4 |
Synovitis on bone scan | 2 | 3 |
Increased IL-6 | 2 | 3 |
Increased α2-globulin | 2 | 3 |
Abnormal sleep pattern | 2 | 3 |
Vomiting | 2 | 2 |
Sweating | 2 | 2 |
Sore throat | 2 | 2 |
Pruritis | 2 | 2 |
Mucositis | 2 | 2 |
Increased SAA | 2 | 2 |
Hypersensitivity to external stimuli | 2 | 2 |
Headache | 2 | 2 |
Abdominal pain | 2 | 2 |
Proteinuria | 2.5 | 1 |
Inflammatory eye disease | 2 | 1 |
Haemoptysis | 2 | 1 |
Alopecia | 2 | 1 |
Increased immune complexes | 1 | 2 |
Increased TNF | 1 | 1 |
Dysuria | 1 | 1 |
Diarrhoea | 1 | 1 |
Constipation | 1 | 1 |
PT, prothrombin time; PTT, partial thromboplastin time; MCV, mean corpuscular time; SAA, serum amyloid A protein.
B.M.F. is supported by a Canada Research Chair. This study was funded in part by an unrestricted grant from Pfizer.
The authors have declared no conflicts of interest.
References
Wallace CA, Levinson JE. Juvenile rheumatoid arthritis: outcome and treatment for the 1990s.
Schneider R, Laxer RM. Systemic onset juvenile rheumatoid arthritis.
Giannini EH, Ruperto N, Ravelli A, Lovell DJ, Felson DT, Martini A. Preliminary definition of improvement in juvenile arthritis.
Medsger TA Jr, Bombardieri S, Czirjak L, Scorza R, Della Rossa A, Bencivelli W. Assessment of disease severity and prognosis.
Brunner HI, Silverman ED, To T, Bombardier C, Feldman BM. Risk factors for damage in childhood-onset systemic lupus erythematosus: cumulative disease activity and medication use predict disease damage.
Brunner HI, Feldman BM, Bombardier C, Silverman ED. Sensitivity of the Systemic Lupus Erythematosus Disease Activity Index, British Isles Lupus Assessment Group Index, and Systemic Lupus Activity Measure in the evaluation of clinical change in childhood-onset systemic lupus erythematosus.
Isenberg DA, Allen E, Farewell V et al. International consensus outcome measures for patients with idiopathic inflammatory myopathies. Development and initial validation of myositis activity and damage indices in patients with adult onset disease.
Rider LG, Giannini EH, Harris-Love M et al. Defining clinical improvement in adult and juvenile myositis.
Kirk S, Carlisle C, Luker KA. The changing academic role of the nurse teacher in the United Kingdom.
Gibson JM. Using the Delphi technique to identify the content and context of nurses’ continuing professional development needs.
Linstone HA, Turoff M. Introduction to the Delphi method: techniques and applications. In: Linstone HA, Turoff M, eds.
Batthish M, Schneider R, Ramanan AV, Achonu C, Young NL, Feldman BM. What does ‘active disease’ mean? patient and parent perceptions of disease activity in the systemic arthritis form of juvenile idiopathic arthritis (So-JIA).
Dillman DA.
Batthish M, Ramanan AV, Schneider R, Achonu C, Feldman BM. Patient and parent perceptions of disease activity in systemic-onset juvenile idiopathic arthritis.
McKenna HP. The Delphi technique: a worthwhile research approach for nursing?
Author notes
1Department of Pediatrics, Division of Rheumatology, Hospital for Sick Children, 2Department of Pediatrics, Hospital for Sick Children, 3Department of Health Policy Management and Evaluation, University of Toronto, 4Graduate Department of Rehabilitation Science, University of Toronto and 5Department of Public Health Sciences, University of Toronto, Toronto, Ontario, Canada.
Comments