Introduction/Overview

In this course we look at the range of survey pretesting methods that can be used to help develop and evaluate survey instruments and measures.

The course will provide participants with:

• An awareness of the range of different pretesting methods available
• An understanding of the strengths and limitations of different pretesting methods
• Experience in using some of the methods
• An understanding of how to combine methods and a framework for doing so

Course objectives

By the end of the workshop, participants will:

• Feel more confident about what survey pretesting is, why it’s done and the methods available
• Be able to compare different pretesting methods, their strengths and weaknesses
• Gain experience in the use of a number of pretesting methods
• Be able to develop a pretesting strategy involving one or more methods

Topics

• Reasons for survey pretesting
• Introduction to different pretesting methods
• desk-based (e.g. Questionnaire Appraisal)
• qualitative (e.g. cognitive interviewing)
• quantitative (e.g. spilt ballot experiments)
• Strengths and limitations of different methods
• Developing pretesting strategies – what to think about

Who will benefit?

Course tutor

Debbie Collins is senior research director in NatCen’s Methods and Innovation Hub and former director of the NatCen Questionnaire Development and Testing Hub. Debbie has tested hundred of survey questions and instruments using a wide range of pretesting methods. She is editor and author of the 2015 Sage book - Cognitive Interviewing Practice - and 2019 Willey book - Advances in Questionnaire Design, Development, Evaluation and Testing.

Course fee payable to SRA.

  This course contributes 6 hours to the MRS CPD programme