The psychometric properties of pen-and-pencil and internet versions of the midlife women's symptom index (MSI)

https://doi.org/10.1016/j.ijnurstu.2004.06.005Get rights and content

Abstract

The purpose of the study was to determine comparability of an Internet format to a Pen-and-Pencil (PP) format of the Midlife Women's Symptom Index (MSI). This study utilized a cross-sectional comparative design with three sections: (a) a PP survey among 77 middle-aged women; (b) an Internet survey among 81 middle-aged women; and (c) an expert review among 20 women's health experts. Both of the PP and the Internet surveys included sociodemographic questions, the MSI, and the Menopausal Symptom Checklist. Data were analyzed using descriptive statistics, K-R20, and correlation coefficients. The findings supported the reliability and validity of both Internet and PP formats of the MSI.

Introduction

Internet research allows people in different geographical areas across the US to communicate and exchange their experiences and opinions at their convenience without long-distance travel (Fawcett and Buhle, 1995). Studies have supported the feasibility of Internet surveys, richness of the electronically collected data, informative and prompt responses of research participants, decreased human errors, and nearly identical results with mail and telephone surveys (Fawcett and Buhle, 1995; Curl and Robinson, 1997; Lakeman, 1997; Pew Research Center for the People and the Press, 1999; Stanton, 1998).

Truell et al. (2002) even reported that Internet surveys were more effective than mail surveys in settings when the target populations had both e-mail and Internet access, although Internet and mail surveys achieved a similar response rate. McCabe et al. (2002) reported that the Internet survey resulted in a final sample that more closely matched the target sample in gender mix than did the mail survey, and the response rate for the Internet survey was significantly higher than for the mail survey. Andersson et al. (2002) recently reported that the data collection format did not result in any substantial difference between the Internet survey and the mail survey. Despite the recent positive findings on the Internet research compared with the traditional research methods including mail surveys and telephone surveys, very little is still known about differences in psychometric properties of the Internet survey format and the traditional survey format of an identical instrument (Riva et al., 2003).

Recently, a measurement scale for symptoms experienced during the menopausal transition, the Midlife Women's Symptom Index (MSI), was developed with an overall goal of development of a general measurement scale to measure symptoms experienced by diverse ethnic groups of women during the menopausal transition. The purposes of the study presented in this paper were to determine comparability of an Internet format to a PP format of the MSI. Specific aims of this study were to:

Aim #1. Determine reliability (internal consistency, inter-item correlations, and item-total correlations) of the PP format and the Internet format of the MSI.

Aim #2. Determine convergent, construct, and face validity of the PP format and the Internet format of the MSI.

Aim #3. Compare item omission, response rate, and completeness of the survey between the PP format and the Internet format.

Section snippets

Methods

This study utilized a cross-sectional comparative design with three sections: (a) a PP survey (Group 1); (b) an Internet survey (Group 2); and (c) an expert review (Group 3).

Findings

The findings supported the internal consistency reliability of the PP format and the Internet format of the MSI (see Table 3). K-R20 for the PP format was 0.94 among all participants, 0.94 among Whites, 0.88 among Asians, and 0.97 among Hispanics. Yet, K-R20 for the PP format among African Americans could not be calculated because of the small sample size of this subgroup (n=4). K-R20 for the Internet format was 0.86 among all the participants, 0.89 among Whites, 0.78 among Hispanics, and 0.86

Discussions

Studies have reported that Internet surveys generate comparable data to PP surveys. Pettit (2002) reported that there was no statistically significant difference between the PP survey data and the Internet survey data. Davis (1999) asserted that findings from Internet-based questionnaire research are comparable with results obtained using standard procedures. Fouladi et al. (2002) indicated that the magnitude of mode of administration effects was in general very small. The findings of the study

Implications and conclusions

In the study presented in this paper, psychometric properties of an Internet format and a PP format of the MSI were determined. The findings supported the reliability and validity of the Internet and PP format of the MSI, and suggested the benefits of the Internet format of the MSI in terms of item omissions and completeness. Based on the discussions on the findings, we want to conclude this paper with the following implications.

First, because the Internet format and the PP format of the MSI

Acknowledgements

This study was funded by the Expedited Proposal-Enhancement Grant (EP-EG) program, the Center for Health Promotion Research: a NIH-funded Research Center, NINR (P30 NR05051).

References (33)

  • ComputersScope Ltd., and others, 2002. NUA Internet surveys. Retrieved February 3, 2002, from...
  • K. Chou et al.

    The reliability and validity of the Chinese version of the caregiver burden inventory

    Nursing Research

    (2002)
  • M. Curl et al.

    Handheld computers in clinical audita comparison with established pen and paper method

    International Journal of Health Care Quality Assurance

    (1997)
  • R.N. Davis

    Web-based administration of a personality questionnairecomparison with traditional methods

    Behav Res Methods Instrum Comput

    (1999)
  • J. Etter et al.

    A comparison of cigarette smokers recruited through the internet or by mail

    International Journal of Epidemiology

    (2001)
  • J. Fawcett et al.

    Using the internet for data collection. An innovative electronic strategy

    Computers in Nursing

    (1995)
  • Cited by (0)

    View full text