Abstract
Objective
To evaluate the inter- and intrareader variability for interpretation of a modified Larsen's radiographic classification system for juvenile rheumatoid arthritis (JRA) focused on osteochondral lesions and a conventional Larsen's classification system, compared to a reference MR scoring system of corresponding images.
Materials and methods
Seventy-five radiographs of 60 children with JRA, performed within a short interval of time from the MR examinations, were independently evaluated by three experienced radiologists, three diagnostic imaging residents and three rheumatologists, in two separate sessions, according to the two different classification methods, blinded to the corresponding MR images.
Results
The inter- and intrareader concordance rates between the two radiographic classification systems and the MR-related radiographs were respectively poor and poor/moderate. The interobserver range of weighted kappa values for the conventional and the modified Larsen's system respectively was 0.25–0.37 vs 0.19–0.39 for radiologists, 0.25–0.37 vs 0.18–0.30 for residents and 0.19–0.51 vs 0.17–0.29 for rheumatologists. The intrareader rate ranged from 0.17–0.55 for radiologists, 0.2–0.56 for residents, and 0.14–0.59 for rheumatologists.
Conclusion
Although the proposal of a new radiographic classification system for JRA focused on osteochondral abnormalities sounds promising, the low inter- and intrareader concordance rates with an MR-related radiographic system makes the clinical applicability of such a radiographic system less suitable.
Similar content being viewed by others
References
Wallace CA, Levinson JE (1991) Juvenile rheumatoid arthritis: outcome and treatment for the 1990s. Rheum Dis Clin North Am 17:891–905
Stanley P, Senac M (1990) Miscellaneous disorders of the musculoskeletal system. In: Cohen MD, Edwards MK (eds) Magnetic resonance imaging of children. Decker, Philadelphia, pp 944–995
Steinbrocker O, Traeger CH, Batterman RC (1949) Therapeutic criteria in rheumatoid arthritis. JAMA 140:659–662
Sharp JT, Lidsky MD, Collins LC, et al (1971) Methods of scoring the progression of radiologic changes in rheumatoid arthritis: correlation of radiologic, clinical, and laboratory abnormalities. Arthritis Rheum 14:706–720
Larsen A, Dale K, Eek M (1977) Radiographic evaluation of rheumatoid arthritis and related conditions by standard reference films. Acta Radiol Diagnosis 18: 481–491
Petterson H, Rydholm U (1984) Radiologic classification of knee joint destruction in juvenile chronic arthritis. Pediatr Radiol 14:719–722
Scott DL, Grindulis KA, Struthers GR, et al (1984) Progression of radiological changes in rheumatoid arthritis. Ann Rheum Dis 43:8-17
Brewer EJ, Bass J, Baum J, et al (1977) Current proposed revision of JRA criteria. Arthritis Rheum 20[Suppl37]:195–199
Doria AS, Kiss MHB, Sallum AM, et al (2001) Correlation between osteochondral changes depicted by magnetic resonance imaging and disease progression. Rev Hosp Clin Fac Med S Paulo 56:107–114
Winalski CS, Palmer WE, Rosenthal DI, et al (1996) Magnetic resonance imaging of rheumatoid arthritis. Radiol Clin North Am 34:243–258
Gubler FM, Algra PR, Maas M, et al (1993). Gadolinium-DTPA enhanced magnetic resonance imaging of bone cysts in patients with rheumatoid arthritis. Ann Rheum Dis 52:716–719
Burk DL Jr, Dalinka MK, Schliebler ML, et al (1988) Strategies for musculoskeletal magnetic resonance imaging. Radiologic Clin North Am 26:653–672
Altman DG (1991) Practical statistics for medical research. Chapman and Hall, London, pp 404–408
Cicchetti H (1981) A computer program for determining the significance of the difference between pairs od independently derived values of kappa or weighted kappa scores. Educational Psychol Meas 41:189–193
Graham TB, Blebea JS, Gylys-Morin V, et al (1997) Magnetic resonance imaging in juvenile rheumatoid arthritis. Semin Arthritis Rheum 27:161–168
Gylys-Morin VM, Graham TB, Blebea JS, et al (2001) Knee in early juvenile rheumatoid arthritis: MR imaging findings. Radiology 220:696–706
Cakmakci H, Kovanlikaya A, Unsal E (2001) Short-term follow-up of the juvenile rheumatoid knee with fat-saturated 3D MRI. Pediatr Radiol 31:189–195
Beltran J, Caudill JL, Herman LA, et al (1987) Rheumatoid arthritis: MR imaging manifestations. Radiology 165:153–157
Foley-Nolan D, Stack JP, Ryan M, et al (1991) Magnetic resonance imaging in the assessment of rheumatoid arthritis—a comparison with plain film radiographs. Br J Rheumatol 30:101–106
Poleksic L, Zdravkovic D, Kablanovic D, et al (1993) Magnetic resonance imaging of bone destruction in rheumatoid arthritis: comparison with radiography. Skeletal Radiol 22:577–580
Gilkeson G, Polisson R, Sinclair H, et al (1988) Early detection of carpal erosions in patients with rheumatoid arthritis: a pilot study of magnetic resonance imaging. J Rheumatol 15:1361–1366
Disler DG (1997) Fat-suppressed three-dimensional spoiled gradient-recalled MR imaging: assessment of articular and physeal hyaline cartilage. AJR 169:1117–1123
Senac MO, Deutsch D, Bernstein BH, et al (1988) MR imaging in juvenile rheumatoid arthritis. AJR 150:873–878
Vuillez JP, Peltier P, Mayer JC, et al (1991) Reproducibility of image interpretation in immunoscintigraphy performed with indium-111- and iodine-131-labeled OC125 F(ab')2 antibody injected into the same patients. J Nucl Med 32:221–226
Brunett A, Tedeschi G, Di Constanzo, et al (1997) White matter lesion detection in multiple sclerosis: improved interobserver concordance with multispectral MRI display. J Neurol 244:586–590
Robinson PJA, Wilson D, Coral A, et al (1999) Variation between experienced readers in the interpretation of accident and emergency radiographs. Br J Radiol 72:323–330
Varich LJ, Laor T, Jaramillo D (2000) Normal maturation of the distal femoral epiphyseal cartilage: age-related changes at MR imaging. Radiology 214:705–709
Acknowledgements
We thank Creusa Dal Bo for her help in the statistical analysis and Edson Amaro Jr, MD for his valuable suggestions. This work was partially supported by an award (salary support) to Andrea S. Doria, M.D., from FAPESP (Fundação de Amparo à Pesquisa do Estado de São Paulo).
Author information
Authors and Affiliations
Corresponding author
Additional information
This manuscript was presented as a scientific exhibit at the 43rd SPR Meeting in Naples, Florida
A commentary onthis paper is available at http://dx.doi.org/10.1007/s00247-003-0957-y
Rights and permissions
About this article
Cite this article
Doria, A.S., de Castro, C.C., Kiss, M.H.B. et al. Inter- and intrareader variability in the interpretation of two radiographic classification systems for juvenile rheumatoid arthritis. Pediatr Radiol 33, 673–681 (2003). https://doi.org/10.1007/s00247-003-0912-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00247-003-0912-y