printContemporary Practices of Telephone Surveys in the World
Zvonovskiy V.B.
Dr. Sci. (Sociol.), Prof. of the Department of Sociology and Psychology of Samara State University of Economics, Samara, Russia. zvb@socio-fond.com
Grigorieva M.V.
Cand. Sci. (Polit.), Prof., Sociology and Psychology Department, Samara State University of Economics. Social Research Found, Samara, Russia mariagrigorieva9@gmail.com
Solovieva J.V.
Graduate Student, Sociology and Psychology Department, Samara State University of Economics. Social Research Found, Samara, Russia j.solovieva@socio-fond.com
Zvonovskiy V.B., Grigorieva M.V., Solovieva J.V. Contemporary Practices of Telephone Surveys in the World. Sotsiologicheskie issledovaniya [Sociological Studies]. 2019. No 1. P. 127-138
The article reviews main approaches and actual trends in telephone surveys in sociological and marketing research. Telephone surveys remain one of the fastest and cheapest ways of primary data collection in sociological and marketing research. They are most consistent with the requirements for representative research. Falsifications of data and measurement errors associated with “interviewer effects” decrease in telephone CATI-surveys. The article describes the approaches and strategies relating to various aspects of the survey – socio-demographic characteristics of landline and mobile phone owners, the dual frame sampling and the problem of plurality, the practice of selecting respondents and conducting interviews, the assessment of failures and cooperation of respondents as well as weighting procedures. In conclusion, various approaches to conducting telephone surveys in Russia are presented.
Звоновский В.Б. Выбор метода исследования и реализация выборки // Социологический журнал. 2012. № 1. С. 107–117. [Zvonovsky V.B. (2012) Choice of the Research Method and the Sampling’s Implementation. Sotsiologicheskiy zhurnal [Sociological Journal]. No.1. Vol. 24: 107–117. (In Russ.)]
Сапонов Д.И. Типы ошибок покрытия в телефонном опросе // Мониторинг общественного мнения: экономические и социальные перемены. 2015. № 4 (128). С. 36–49. [Saponov D.I. (2015) Coverage Error Typology in Telephone Survey. Monitoring obshchestvennogo mneniya: ehkonomicheskie i sotsialnye peremeny [Monitoring of Public Opinion: Economic and Social Changes]. No. 4: 36–49. DOI: 10.14515/monitoring.2015.4.02. (In Russ.)]
AAPOR (2010). New Considerations for Survey Researchers when Planning and Conducting RDD Telephone Surveys in the US with Respondents Reached via Cell Phone Numbers.
AAPOR (2016). Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys.
Abraham K.G., Maitland A., Bianchi S.M. (2006) Nonresponse in the American Time Use Survey: Who Is Missing from the Data and How Much Does It Matter? International Journal of Public Opinion Quarterly. Vol. 70. No 5: 676–703.
Andreenkova A. (2012) Russia. In: Häder S. et al. (eds) Telephone Surveys in Europe: Research and Practice. Berlin: Springer-Verlag: 3–17.
Baffour B. et al. (2016) Weighting Strategies for Combining Data from Dual-frame Telephone Surveys: Emerging Evidence from Australia. Journal of Official Statistics. Vol. 32. No 3: 549–578.
Baker R.J. et al. (2013) Summary Report of the AAPOR Task Force on Non-probability Sampling. Journal of Survey Statistics and Methodology. No. 1: 90–143. DOI: https:/doi.org/10.1093/jssam/smt008.
Barr M.L. et al. (2012) Inclusion of Mobile Phone Numbers into an Ongoing Population Health Survey in New South Wales, Australia: Design, Methods, Call Outcomes, Costs and Sample Representativeness. BMC Medical Research Methodology. Vol. 12. No. 1: 177.
Blumberg S.J., Luke J.V. (2017) Wireless Substitution: Early Release of Estimates from the National Health Interview Survey, July–December 2016 In: National Center for Health Statistics. URL: https://www.cdc. gov/nchs/data/nhis/earlyrelease/wireless201705.pdf (accessed 01.08.18).
Blumberg S.J., Luke J.V. (2009) Reevaluating the Need for Concern Regarding Noncoverage Bias in Landline Surveys. American Journal of Public Health. Vol. 99. No. 10: 1806–1810.
Brick J.M. et al. (2007) Cell Phone Survey Feasibility in the US: Sampling and Calling Cell Numbers versus Landline Numbers. Public Opinion Quarterly. Vol. 71. No. 1: 23–39.
Brick J.M., Edwards W.S., Lee S. (2007) Sampling Telephone Numbers and Adults, Interview Length, and Weighting in the California Health Interview Survey Cell Phone Pilot Study. Public Opinion Quarterly. Vol. 71. No. 5: 793–813.
Brick J.M. et al. (2011) Nonsampling Errors in Dual Frame Telephone Surveys. Survey Methodology. Vol. 37. No. 1: 1–12.
Brick J.M., Williams D. (2013) Explaining Rising Nonresponse Rates in Cross-sectional Surveys. The ANNALS of the American Academy of Political and Social Science. Vol. 645. No. 1: 36–59.
Buskirk T.D., Best J. (2012) Venn Diagrams, Probability 101 and Sampling Weights Computed for Dual Frame Telephone RDD Designs. Journal of Statistics and Mathematics. Vol. 15: 3696–3710.
Busse B., Fuchs M. (2013) Prevalence of Cell Phone Sharing. In: Survey Methods: Insights from the Field. URL: https://surveyinsights.org/?p=1019 (accessed 01.08.2018). DOI:10.13094/SMIF-2013-00004.
Callegaro M., Poggio T. (2004) Where Can I Call You? The “Mobile (Phone) Revolution” and Its Impact on Survey Research and Coverage Error: a Discussion of the Italian Case. In: 6th International Conference on Logic and Methodology. Amsterdam, Netherlands, 16–20 August.
Global Market Research. An ESOMAR Industry Report. 2016. (2017)
Elkasabi M.A. (2015) Weighting Procedures for Dual Frame Telephone Surveys: A Case Study in Egypt. In: Survey Methods: Insights from the Field. Weighting: Practical Issues and ‘How to’ Approach. URL: https://surveyinsights.org/?p=5291 (accessed 01.08.2018). DOI:10.13094/SMIF-2015-00005.
Gaziano C. (2005) Comparative Analysis of Within-household Respondent Selection Techniques. Public Opinion Quarterly. Vol. 69. No. 1: 124–157.
Groves R.M. et al. (eds) (1988). Telephone Survey Methodology. Wiley, New York.
Groves B. (2004) Interviewer Falsification in Survey Research: Current Best Methods for Prevention, Detection, and Repair of its Effects. Survey Research. Vol. 35. No. 1: 1–5.
Guterbock T.M. et al. (2011) Who Needs RDD? Combining Directory Listings with Cell Phone Exchanges for an Alternative Telephone Sampling Frame. Social Science Research. Vol. 40. No. 3: 860–872.
Haeder S., Lehnhoff I., Mardian E. (2010) Mobile Phone Surveys: Empirical Findings from a Research Project. ASK: Research & Methods. No. 19: 3–19.
Holbrook A.L., Krosnick J.A., Pfent A. (2008). The Causes and Consequences of Response Rates in Surveys by the News Media and Government Contractor Survey Research Firms. In: Lepkowski J. et al. (eds) Advances in Telephone Survey Methodology. New York: Wiley: 499–528.
Hu S.S. et al. (2011) Improving Public Health Surveillance Using a Dual-frame Survey of Landline and Cell Phone Numbers. American Journal of Epidemiology. Vol. 173. No. 6: 703–711.
Kalsbeek W.D., Agans R.P. (2007) Sampling and Weighting in Household Telephone Surveys. In: Advances in Telephone Survey Methodology. Wiley Blackwell: 27–55. DOI: 10.1002/9780470173404.
Keeter S. et al. (2000) Consequences of Reducing Nonresponse in a National Telephone Survey. Public Opinion Quarterly. Vol. 64. No. 2: 125–148.
Keeter S. et al. (2006) Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey. Public Opinion Quarterly. Vol. 70. No. 5: 759–779.
Keeter S. et al. (2008) Cost and Benefits of Full Dual Frame Sample Telephone Survey Design. In: 63th Annual Conference of the American Association for Public Opinion Research. New Orleans, LA.
Kuusela V. (2003) Mobile Phones and Telephone Survey Methods In: Banks R. et al. (eds) Proceedings of the 4th ASC International Conference ASC 2003 – The Impact of New Technology on the Survey Process, Association for Survey Computing (ASC). Chesham Bucks: 317–327.
Lambert D., Langer G., McMenemy M. (2010) Cell-phone Sampling: an Alternative Approach. In: The Annual Conference of the American Association for Public Opinion Research. Chicago, IL, May 14.
Langer G. (2003) About Response Rates: Some Unresolved Questions. In: Public Perspective. May/June: 16–18.
Langer G. (2015) ABC News' Polling Methodology and Standards. URL: http://abcnews.go.com/US/PollVault/ abc-news-polling-methodology-standards/story?id=145373 (accessed 01.08.2018).
Lavrakas P.J. (1987) Telephone Survey Methods: Sampling, Selection, and Supervision. Sage Publications, Inc.
Lee S. et al. (2010) Growing Cell Phone Population and Noncoverage Bias in Traditional Random Digit Dial Telephone Health Surveys. Health Services Research. Vol. 45. No. 4: 1121–1139.
Link M.W. et al. (2007) Reaching the US Cell Phone Generation Comparison of Cell Phone Survey Results with an Ongoing Landline Telephone Survey. Public Opinion Quarterly. Vol. 71. No. 5: 814–839.
Livingston M. et al. (2013) Surveying Alcohol and Other Drug Use through Telephone Sampling: a Comparison of Landline and Mobile Phone Samples. BMC Medical Research Methodology. Vol. 13. No. 1: 41.
Lohr S. (2011) Alternative Survey Sample Designs: Sampling with Multiple Overlapping Frames. Survey Methodology. Vol. 37. No. 2: 194–213.
Lynn P., Kaminska O. (2013) The Impact of Mobile phones on Survey Measurement Error. Public Opinion Quarterly. Vol. 77. No. 2: 586–605.
Mardian E. et al. (2010) Mobile Phone Surveys: Empirical Findings from a Research Project. ASK: Research & Methods. No. 19: 3–19.
Matthews T. et al. (2016) She'll Just Grab Any Device That's Closer: A Study of Everyday Device & Account Sharing in Households. In: CHI Conference on Human Factors in Computing Systems. ACM: 5921–5932.
Menold N., Kemper C.J. (2013) How Do Real and Falsified Data Differ? Psychology of Survey Response as a Source of Falsification Indicators in Face-to-face Surveys. International Journal of Public Opinion Research. Vol. 26. No. 1: 41–65.
Merkle D., Langer G. (2008) How Too Little Can Give You a Little Too Much Determining the Number of Household Phone Lines in RDD Surveys. Public Opinion Quarterly. Vol. 72. No. 1: 114–124.
Mohorko A., de Leeuw E., Hox J. (2013) Coverage Bias in European Telephone Surveys: Developments of Landline and Mobile Phone Coverage across Countries and Over Time. In: Survey Methods: Insights from the Field. URL: https://surveyinsights.org/?p=828 (accessed 01.08.2018). DOI:10.13094/ SMIF-2013-00002.
Roe D.J., Currivan D.B. (2006) Using Dual-Frame Sample Designs to Increase the Efficiency of Reaching General Populations and Population Subgroups in Telephone Surveys In: Second International Conference on Telephone Survey Methodology. Miami, FL.
Singer E., Presser S. (2008) Privacy, Confidentiality, and Respondent Burden as Factors in Telephone Survey Nonresponse In: J.M. Lepkowski et al. (eds) Advances in Telephone Survey Methodology. Hoboken: Wiley: 447–470.
Tourangeau R. (2004) Survey Research and Societal Change. In: Annual Review Psychology. Vol. 55: 775–801.
Vicente P., Reis E., Santos M. (2009) Using Mobile Phones for Survey Research. International Journal of Market Research. Vol. 51. No. 5: 613–633.