Thursday, July 02, 2009

Writing Effective Surveys and Questionnaires Top Tips

Writing surveys is easy; or is it? The reality is that writing surveys is easy but writing effective surveys is more difficult. The following are twenty tips that if followed will help you with your survey questionnaire design and help you write effective surveys.

1. What is the purpose of the survey?

There are many reasons for conducting surveys. By phrasing the questions and structuring the answers surveys can be used in a multitude of ways and for a variety of reasons. When designing a survey do not lose sight of its purpose.

2. Title the survey

The title of the survey is an opportunity to instantly summarise a survey's objective and encourage respondents to participate. Respondents need to invest time in completing the survey so encourage them that the investment they make will be worthwhile.

3. Ensure that you do not make the survey any longer than it needs to be

Every question asked should be asked for a reason. Minimize asking questions that will provide you with 'nice to know' information and concentrate instead on 'need to know' questions.

4. Use plain English, maintain consistency, avoid jargon and acronyms and don't ask questions that may result in ambiguous answers

Care must be taken in wording a question. If a question can be interpreted in more ways than one then there is a risk that any analysis of the survey results will be worthless or at the very least suspect.

5. Don't have long questions

Use concise sentences wherever possible. Long questions can cause a respondent discomfort and lead to them abandoning the survey.

6. Ask only one question at a time

Avoid confusing the respondent with a question like 'Do you like athletics and tennis?'

7. Don't influence the answer

It is important not to load the question. 'Should irresponsible shop keepers who sell cigarettes to minors be prosecuted?' is likely to have no value.

8. Make sure that the answer format used allows the respondent to answer the question being asked

Ensure that the respondent is able to answer how they really feel or they may abandon the survey. As a last resort consider the benefit of including a "No comment", "Can't say", "Don't know" or similar response option.

9. While you are compiling your survey consider how the survey results are going to be analysed when the survey is complete


When asking questions that allow for a free text open ended response, such as when asking the respondent for their comments, appreciate that such information is likely to be difficult to score and/or summarised. Consider how the answers could be grouped. For example "Indicate your length of service?" - 'less than 1 year', 'between 1 and 4 years' and 'more than 4'.

10. Ensure that the questionnaire flows

Group the questions into clear categories as this makes the task of completing the survey easier for the participants.

11. Target your respondents carefully

Sometimes you will want to target a specific group, in others a cross section. If you can't easily control the respondents consider including questions/answers that will allow you to filter out respondents that don't match your target profile.

12. Allow the respondent to expand on their answer or make comments

Allowing respondents to make additional comments will increase their satisfaction level and the comments will also give valuable feedback on the specific questions and/or the survey as a whole. Remember though for a large sample collection it may be difficult to analyze free text open ended responses.

13. If you are conducting a confidential survey ensure that your pledge for confidentiality is honoured

If you have assured respondents that the survey is to be confidential you need to ensure that the collated data is not shared with anyone or used for any other purpose. Confidentiality must be maintained and any contact information deleted after the survey is complete.

14. Consider the benefits and disadvantages of allowing respondents to be anonymous or identifiable

If your respondents are to be anonymous then you will be unable to follow up specific complaints or match "pre" or "post" surveys. However in some cases allowing respondents to remain anonymous will allow respondents to respond without possible peer pressure.

15. Carefully consider the best response format

Maintaining a consistency in the format used for responses is good practice. When creating your survey keep in mind that when analyzing the data radio buttons are easier to analyze than check boxes that offer the respondent multiple responses. Do not use a check box if a radio response would do.

16. Give the respondent an estimate as to how much time the survey will take to complete

If the survey appears to be a stream of never ending questions then respondent drop out can occur. It is good practice to give an indication as to how long the survey is likely to take so that the participants can choose the best time to complete the survey.

17. Provide respondents with the survey end date

Encourage respondents to complete the survey as soon as possible but advise respondents as to the survey’s end date so that they have the opportunity to schedule the necessary time.

18. Trial the survey

Before publishing a live survey publish the survey as a trial to check for questions that are ambiguous or confusing and to ensure that the survey is aesthetically pleasing.

19. Before publishing the survey proof read the survey carefully

Check and check again that the survey is grammatically correct and makes sense. If practical get a colleague to check the survey before you publish, if no one else is available then take a break before checking again.

20. Thank the respondents

To complete surveys respondents need to invest their time and they should be thanked at the end of completing the survey or in a follow up letter. You may even want to consider incentives such as a reward of some sort.

Getting started is easy and there are many survey software websites to choose from.

1 comment:

Anonymous said...

thanks a lot...this will surely help in our research