An Internet-based survey method for college student drinking research

https://doi.org/10.1016/j.drugalcdep.2004.04.001Get rights and content

Abstract

The purpose of this study was to describe and assess the utility of an Internet-based survey method for characterizing the alcohol consumption of college students. After extensive pilot research, a random sample of 1910 students aged 16–29 years was invited to complete a questionnaire, consisting of a series of web-pages linked to a relational database on a secure web-site. A branch structure allowed for tailoring of survey items by age and gender. The students received up to nine contacts, including a pre-notice letter with a token gift and an e-mail invitation (Phase 1), a reminder letter and e-mail message (Phase 2), and then telephone reminders and replacement access codes (Phase 3). Non-computer-users were offered a pen-and-paper alternative, making this a mixed-mode survey. The overall response to the survey was 82% (n=1564). The median completion time was 16.7 min. Participants’ comments showed high levels of satisfaction with the survey. Comparison of web (n=1501) versus pen-and-paper completions (n=63) revealed no modality effects. Technical problems addressed during the course of implementation included web-browser-operating system incompatibilities, and periodic network errors, although these resulted in little lost participation. Internet-based surveys are feasible for college student research and with carefully managed recruitment, can yield a high response.

Section snippets

Sample

The study sample consisted of 1910 students aged 16–29 years, randomly selected from the enrolment database of the University of Otago, a public institution, with around 17,000 students, the third largest of eight universities in New Zealand. The south island city of Dunedin, where the main campus is situated, has a population of 120,000 people.

Recruitment

A three-phase recruitment procedure was used.

Survey response

Of 1910 randomly sampled students, 331 (17.3%) did not respond at all. In eight cases (0.4%), the sampled individual started the survey but did not proceed far enough to meet the core data requirement. Seven cases (0.4%) with evidence of a response set or other significant inconsistencies were considered invalid and were reclassified as non-respondents. The total non-response was thus 18.1%. Complete responses were received from 1520 students (79.6%). In a further 44 cases (2.3%), although the

Discussion

We observed a spike in the response rate in the 3 days following posting of the invitation letter and e-mail message, followed by a refractory period. The posting of a second letter and reminder e-mail message resulted in another spike in the response rate, followed by a rapid decline. Intensive follow-up, particularly with the use of telephone reminders and the provision of replacement e-mails containing the hypertext link to the web questionnaire, produced a steady response for the following

Conclusions

For the survey researcher, the Internet offers many exciting possibilities. In the general population, in which Internet access is still well below levels required to overcome problems of coverage bias, many of these possibilities cannot yet be realized. In certain groups, however, coverage is presently sufficient for the use of this technology for both epidemiological purposes and health promotion (e.g. college and high school students).

Research is beginning to mount on various aspects of

Acknowledgements

This research was funded by the Health Research Council of New Zealand and the Alcohol Advisory Council of New Zealand. The authors are grateful to Associate Professor David Chalmers and two anonymous reviewers for valuable comments on an earlier draft of the paper.

References (29)

  • R. Caetano

    Non-response in alcohol and drug surveys: a research topic in need of further attention

    Addiction

    (2001)
  • S. Casswell et al.

    Survey data need not underestimate alcohol consumption

    Alcohol Clin. Exp. Res

    (2002)
  • M. Couper

    Web surveys: a review of issues and approaches

    Public Opin. Q

    (2000)
  • Dillman, D.A., 1978. Mail and Telephone Surveys: The Total Design Method. Wiley, New...
  • Dillman, D.A., 2000. Mail and Internet Surveys: The Tailored Design Method. Wiley, New...
  • P. Edwards et al.

    Increasing response rates to postal questionnaires: systematic review

    Br. Med. J

    (2002)
  • Gliksman, L., Demers, A., Adlaf, E.M., Newton-Taylor, B., Schmidt, K., 2000. Canadian Campus Survey 1998. Centre for...
  • Jones, S., Madden, M., 2002. The Internet goes to college: how students are living in the future with today’s...
  • K. Kypri et al.

    Incentives to increase participation in an internet survey of alcohol use: a controlled experiment

    Alcohol Alcohol

    (2003)
  • K. Kypri et al.

    Perceived norms and their relation to university student drinking

    J. Stud. Alcohol

    (2003)
  • K. Kypri et al.

    High prevalence, persistent hazardous drinking in New Zealand tertiary students

    Alcohol Alcohol

    (2002)
  • Kypri, K., McAnally, H., 2003. Tertiary student access to the Internet in New Zealand: implications for health...
  • K. Kypri et al.

    Interpretation of items on the AUDIT questionnaire

    Alcohol Alcohol

    (2002)
  • K. Kypri et al.

    Acceptability of various brief intervention approaches for hazardous drinking among university students

    Alcohol Alcohol

    (2003)
  • Cited by (115)

    • Do recreational cannabis users, unlicensed and licensed medical cannabis users form distinct groups?

      2017, International Journal of Drug Policy
      Citation Excerpt :

      Nevertheless, this method was chosen because it provides ease of access, broader reach, anonymity, and has been shown to reduced response bias on sensitive topics such as drug use (Ramo, Liu, & Prochaska, 2012). Indeed, extant research provides strong evidence that web-based surveys represent a valid and reliable mode for collecting substance use data (Kypri, Gallagher, & Cashell-Smith, 2004; McCabe, Boyd, Couper, Crawford, & D'Arcy, 2002) and research shows that over 90% of secular Israelis aged 12 and above are connected to the internet (Dror & Gershon, 2012). In the present study we checked the IP addresses and found no double entries by the same participants, thus organized multiple responding did probably not occur.

    View all citing articles on Scopus
    View full text