Biases in Random Route Surveys

* Address correspondence to Johannes J. Bauer , Institute for Sociology, Ludwig-Maximilians University Munich, München 80539, Germany; E-mail: johannes.bauer@soziologie.uni-muenchen.de .

Journal of Survey Statistics and Methodology, Volume 4, Issue 2, June 2016, Pages 263–287, https://doi.org/10.1093/jssam/smw012

Cite

Johannes J. Bauer, Biases in Random Route Surveys, Journal of Survey Statistics and Methodology, Volume 4, Issue 2, June 2016, Pages 263–287, https://doi.org/10.1093/jssam/smw012

Abstract

Although random routes are an important face-to-face sampling method, there is very little research about the procedure. The idea that random route sampling leads to a uniform selection of households has never been tested. This study challenges this notion in a simulation and uses registration office data to verify the impact of selection errors on survey results. All tested routes strongly violate the equal probability assumption and lead to biased expected values in multiple variables. The strongest errors were found in variables that were related to the spatial location of households. Furthermore, errors were related not only to random route instructions but also to the selection of starting points for these routes. This study is of relevance for scientists using random route data for their research as well as for surveys applying random route procedures. Data analysts can use the results to gain an impression about the degree of bias, whereas researchers that use random route samples should view these findings as inducement to improve the random route methodology and develop alternatives.

© The Author 2016. Published by Oxford University Press on behalf of the American Association for Public Opinion Research. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com