Web surveys versus other survey modes

ǂa ǂmeta-analysis comparing response rates

Katja Lozar Manfreda (Author), Michael Bošnjak (Author), Jernej Berzelak (Author), Iris Haas (Author), Vasja Vehovar (Author)

Abstract

One question that arises when discussing the usefulness of web-based surveys is whether they gain the same response rates compared to other modes of collecting survey data. A common perception exists that, in general, web survey response rates are considerably lower. However, such unsystematic anecdotal evidence could be misleading and does not provide any useful quantitative estimate. Metaanalytic procedures synthesising controlled experimental mode comparisons could give accurate answers but, to the best of the authors' knowledge, such research syntheses have so far not been conducted. To overcome this gap, the authors have conducted a meta-analysis of 45 published and unpublished experimental comparisons between web and other survey modes. On average, web surveys yield an 11% lower response rate compared to other modes (the 95% confidence interval is confined by 15% and 6% to the disadvantage of the web mode). This response rate difference to the disadvantage of the web mode is systematically influenced by the sample recruitment base (a smaller difference for panel members as compared to one-time respondents), the solicitation mode chosen for web surveys (a greater difference for postal mail solicitation compared to email) and the number of contacts (the more contacts, the larger the difference in response rates between modes). No significant influence on response rate differences can be revealed for the type of mode web surveys are compared to, the type of target population, the type of sponsorship, whether or not incentives were offered, and the year the studies were conducted. Practical implications are discussed.

Keywords

Spletne ankete;Ankete;Statistična analiza;Primerjalna analiza;

Data

Language:	English
Year of publishing:	2008
Typology:	1.01 - Original Scientific Article
Organization:	UL FDV - Faculty of Social Sciences
UDC:	303
COBISS:	27042397
ISSN:	1470-7853
Views:	457
Downloads:	170
Average score:	0 (0 votes)
Metadata:

Other data

Secondary language:	English
Secondary keywords:	Web surveys;Opinion polls;Statistical analysis;Comparative analysis;
Type (COBISS):	Scientific work
Pages:	str. 79-104
Volume:	ǂVol. ǂ50
Issue:	ǂno. ǂ1
Chronology:	2008
ID:	11950252