DIY survey tools such as Survey Monkey, Zoomerang, Survey Gizmo or Quick Survey are freely available making research far more accessible to smaller and medium enterprises, than ever before. The tools themselves too, have also developed quickly offering more features and options to the DIY researcher.
However just having a hammer and a saw does not make you a carpenter and along with the increasing number of organisations currently doing surveys comes the risk of poorly designed and executed surveys. Now given the main reason to do research is to inform decision making means the quality of your decision making can be impacted by the quality of your research and in particular your survey questionnaire.
So the team at Survey Human thought it was time to give some broad tips on how to ensure you not only ask the right questions by also ask these questions the right way.
Here are our top 10 expert tips to get you started:
Itâ€™s imperative you spend some time at base camp before setting off. Think long and hard about your survey, who are you targeting? how will you get them and how will you ensure they are representative of the target audience? What issues do you anticipate? How long will the survey be? Think about these types of questions and try to write down on one page a research plan.
2. Goals and Objectives
Research usually starts with a business problem â€“ try and define this in a sentence or two (what is the reason for doing this research?). Once you have done this try to define the decisions you will make at the end of the research. This is a really neat way to focus your goals and objects. Finally translate this into an overall objective and supporting objectives to get the job done. This will then be your master plan for the creation of your survey.
3. Design and Structure
Before you put pen to paper start to plan out your design. Think in terms of broad topics or sections. Usually you will need to start with some sort of screening questions to ensure you are talking to the right people, you might want to mask this question by giving multiple options to reduce self-selection. Then introduce the subject or category from a broad perspective narrowing down into specifics as you go. Finally finish with a classification section and always ask sensitive questions like Income at the end.
4. Survey Length
Survey length is one of the most important considerations in quality research â€“ generally the shorter the better, but you have also got to balance this with meeting your objectives. Try to keep your surveys to 5-15 minutes, and offer incentives for longer surveys. One way of doing this is to ensure that each question is matched to a specific objective. Think of it as each question earning the right to be there. If itâ€™s a nice to know and you donâ€™t have room its out! Itâ€™s a good idea also to tell respondents realistically how long the survey will take.
5. Minimise Bias
Bias is the most common cause of poor research. Although eliminating bias is almost impossible it is important to plan strategies to minimise it at all costs. Some of the key strategies to consider are: always have balanced scales (agree or disagree), donâ€™t introduce topics that will affect later questions (plan an order), donâ€™t use double barrelled questions, match your questions to the responses you offer, include randomisations of answers where possible, and always provide clear instructions to respondents.
6. Question Routing
Make sure you define who answers each question clearly and use skip logic to ensure that the respondent only sees the relevant questions. Again go back to your plan and think about how this will work up front keeping relevant sections and questions together.
7. Timing and Testing
Once you have programmed your questionnaire take the time to thoroughly test it including all the skip logic. Pilot it on your colleagues and ask for their candid feedback â€“ was there anything they didnâ€™t understand or wasnâ€™t clear. When you finally launch your survey check the data after the first day to ensure that all the right questions are been appropriately completed.
8. Sample Size and Quotas
Although it might be tempting to get as many responses as possible itâ€™s important to control the sample you end up with by setting up quotas. There is not point having 70% females in your survey if you are doing a population survey where the actual proportion is closer to 50%. This will introduce a bias to your results. Sample size is important too and as a rule of thumb sample sizes of over 1,000 will generally not increase your accuracy so spend more time getting the right sample than the biggest sample. Use reminders to get at harder to achieve sub-samples like younger males.
9. Data Cleaning
Itâ€™s really important that you also clean your data when your survey is finished. Look for responses that are inconsistent, contain â€˜rubbishâ€™ answers to open ended questions or were completed too quickly (they might just be clicking anything to complete). Itâ€™s a good idea to oversample by 10% to allow for the removal of some respondents.
10. Data Analysis and Reporting
This is perhaps the most specialised skill required in the survey process. If you are not comfortable with how to process the data then perhaps think about investing a small sum into professional help. There is a lot to consider including filtering questions, bases, weighting, creating statistics, analysis banners and statistical testing to discover real differences. Most of the packages offer some sort of basic analysis tools but be careful with your analysis and check it thoroughly to ensure it is correct and before you start drawing conclusion and writing a report.
Survey Human is here to help you on any or all of these areas â€“ check out our affordable help packages and ensure that your next research project is a success.