Research articles
Validity and reliability of self-reported arthritis: Georgia Senior Centers, 2000–2001

https://doi.org/10.1016/j.amepre.2004.12.004Get rights and content

Background

Arthritis and other rheumatic conditions are a common cause of disability among adults in the United States. Telephone interviews of the state-based Behavioral Risk Factor Surveillance System (BRFSS) are used by states and territories to estimate the prevalence of arthritis. The purpose of this study was to assess the validity and reliability of the 1996–2001 BRFSS arthritis case definition in a senior center population.

Methods

A total of 487 respondents at selected senior centers in Georgia were surveyed by telephone, evaluated 3 to 4 weeks later by board-certified rheumatologists, and completed a written survey in 2000 to 2001. Using the rheumatologists’ summary assessment “Does this person have arthritis or a related condition” as the standard, the sensitivity and specificity of the BRFSS arthritis case definitions were calculated. Reliability for the BRFSS arthritis case definition was also calculated by comparing responses to the telephone survey with responses to a written survey.

Results

Sensitivity was 70.8% (95% confidence interval [CI]=65.9–75.6), and the specificity was 70.3% (95% CI=62.9–77.8). The agreement between the telephone and written responses indicating self-reported arthritis was high (κ=0.68). Analyses were conducted in 2002 to 2004.

Conclusions

Self-reported arthritis in the 1996–2001 BRFSS was highly reliable, and moderately sensitive and specific among these senior center participants.

Introduction

Arthritis and other rheumatic conditions are among the most prevalent diseases in the United States.1 They include a wide range of illnesses and conditions,2 the more common of which are osteoarthritis, rheumatoid arthritis, fibromyalgia, and gout,3 and most share the characteristics of pain, aching, stiffness, or swelling in or around the joints.2 Arthritis is a leading cause of disability among adults in the United States,4 with direct and indirect costs estimated at $86.2 billion in 1997.5 Quality of life is also consistently worse for people with arthritis, compared with people without arthritis, because of pain, discomfort, reduced mobility, and the negative impact the disease can have on mental health.6, 7

Although arthritis is clearly a public health burden, it receives less attention than diseases associated with acute mortality.8 Arthritis is also a challenging subject of epidemiologic study due to inherent difficulties in defining a case and clearly distinguishing among different disorders.9 Estimates of overall arthritis prevalence in the United States have been drawn from the self-reported data of the National Health Interview Survey (NHIS),10, 11 which used an approach that required respondents to answer affirmatively to a short list of conditions, and be subsequently classified as having arthritis or other rheumatic conditions. According to these data, 16% of people classified with arthritis had not seen a doctor for their condition,12 a finding that demonstrates the inability of healthcare system data to properly estimate arthritis prevalence and supports the use of self-reported data, such as the data collected in the state-based Behavioral Risk Factor Surveillance System (BRFSS), for a more complete population prevalence estimate of arthritis.

Assessments of the accuracy of self-reported data for arthritis are limited to a few studies of small groups.13, 14 Although the validity and reliability of hypertension, diabetes, and other topics included on the BRFSS have been published,15 to date no studies have published findings on the validity and reliability of the BRFSS arthritis case definition.* The purpose of this study was to assess the validity and reliability of the BRFSS arthritis case definition in a senior center population aged ≥50 years.

Section snippets

Study population

A convenience sample of senior center attendees residing in Georgia was chosen for this study population because of a probable high prevalence of arthritis and ease of providing a rheumatologic assessment. To achieve demographic balance in the sample, participants were recruited from 12 senior centers categorized by race/ethnicity (black, white); socioeconomic status (SES) (low, medium/high); and center location (urban, suburban, rural). A list of Georgia senior centers was compiled using

Description of participants

Compared to BRFSS respondents aged ≥50, study participants were significantly more likely to be older, black, female, poor, widowed, report any physical activity, have had a checkup within the past year, and no unhealthy days (Table 1). More study participants were classified with self-reported arthritis, original compared to the comparable BRFSS population (58.5% vs 52.2%), but this difference was not significant. Study participants were significantly more likely than BRFSS respondents to be

Discussion

Self-reported arthritis was highly reliable and, using a history and physical examination by board-certified rheumatologists as the gold standard, was moderately sensitive and specific.

Misclassification yielded different results for false-negative and false-positive participants. False negatives reported better health than true positives, and may have minimized their symptoms, making them less likely to report symptoms during the telephone interview. Conversely, false positives reported worse

References (22)

  • L.F. Callahan et al.

    Arthritis and women’s healthprevalence, impact, and prevention

    Am J Prev Med

    (1996)
  • Factors associated with prevalent self-reported arthritis and other rheumatic conditions—United States, 1989–91

    MMWR Morb Mortal Wkly Rep

    (1996)
  • R.C. Lawrence et al.

    Estimates of the prevalence of arthritis and selected musculoskeletal disorders in the United States

    Arthritis Rheum

    (1998)
  • Prevalence of disabilities and associated health conditions among adults—United States, 1999

    MMWR Morb Mortal Wkly Rep

    (2001)
  • Updatedirect and indirect costs of arthritis and other rheumatic conditions—United States, 1997

    MMWR Morb Mortal Wkly Rep

    (2004)
  • F.D. Mili et al.

    Health related quality of life among adults reporting arthritisanalysis of data from the Behavioral Risk Factor Surveillance System, US, 1996–99

    J Rheumatol

    (2003)
  • A. Praemer et al.

    Muskuloskeletal conditions in the United States

    (1999)
  • A.J. Silman et al.

    Epidemiology of the rheumatic diseases

    (2001)
  • Prevalence of arthritis, United States, 1997

    MMWR Morb Mortal Wkly Rep

    (2001)
  • Arthritis prevalence and activity limitations, United States, 1990

    MMWR Morb Mortal Wkly Rep

    (1994)
  • Cited by (88)

    • Comparing self-reports to national register data in the detection of disabling mental and musculoskeletal disorders among ageing women

      2022, Maturitas
      Citation Excerpt :

      However, simple self-reports have gained less attention in the context of MDs and MSDs. Self-reports of depression [14] and arthritis [14–17] have moderate accuracy. Also, contradictory findings exist [10,15].

    • Association of childhood physical and sexual abuse with arthritis in adulthood: Findings from a population-based study

      2021, Preventive Medicine Reports
      Citation Excerpt :

      Respondents who answered “yes” were coded as 1, whereas respondents who answered “no” were coded as 0. This item has been found to provide reliable overall arthritis surveillance with adequate sensitivity and specificity (Bombard et al., 2005; Sacks et al., 2005) and has been used in other population-based studies (Barbour et al., 2013, 2017; Fontaine et al., 2007; Guglielmo et al., 2018; Hootman et al., 2016). The main explanatory variables examined in this paper were CPA and CSA and were both measured as binary variables.

    View all citing articles on Scopus
    View full text