Asking the Questions

Michael Wagstaff • 15 September 2023

Top tips for insightful questionnaires

Putting together an insightful survey requires a thoughtful approach to question design. Properly framed questions elicit more accurate responses, ensuring the collected data truly represents the sentiments of your audience. 

This article provides a clear guide on best practices to consider when creating survey questions.

1. Keep it Clear and Concise:
Survey respondents should be able to understand a question instantly. Avoid using jargon, acronyms or technical language. If your survey targets a specific audience familiar with certain terms, ensure clarity isn’t sacrificed for brevity.

2. Use Specific Language:
Broad or vague questions leave room for varied interpretations. Instead of asking, "Are you satisfied with our services?", be specific, such as "How satisfied are you with our customer support responsiveness?"

3. Avoid Leading Questions:
Your questions should be neutral and shouldn’t hint at a preferred answer. For instance, "Don’t you think our new product is groundbreaking?" is leading. Instead, use "How would you describe our new product?"

4. Stick to One Topic per Question:
Double-barreled questions address two topics but only allow for one answer, which can be confusing. Split them. Instead of "How satisfied are you with our product quality and delivery time?", separate it into two distinct questions.

5. Provide a Neutral Option:
For scaled questions, always include a midpoint or neutral option, such as "neither agree nor disagree," to capture respondents who genuinely sit in the middle.

6. Avoid Absolute Terms:
Questions with words like "always" or "never" may be too extreme for many respondents. Instead, use scales like "often," "sometimes," and "rarely."

7. Ensure All Possible Responses are Covered:
Multiple choice questions should encompass all likely answers. It’s always wise to include an "Other" option with a fill-in box for unexpected answers.

8. Use Open-ended Sparingly:
While open-ended questions can provide rich qualitative data, they might also deter participants because they require more effort to answer. Use them strategically.

9. Be Mindful of Bias:
Review your questions to ensure they’re free from personal bias, cultural assumptions or gender biases. Such biases could skew results and alienate respondents.

10. Randomise Answer Choices:
For multiple choice questions, it's good practice to randomise the answer choices (except where a logical order is needed). This minimises the chance of response bias.

11. Test Your Survey:
Before rolling out your survey, test it with a pilot group. This will highlight confusing questions, technical hiccups or issues you might have overlooked.

12. Respect Respondent’s Time:
Long surveys can lead to respondent fatigue, which can impact data accuracy. Make sure your survey is as concise as possible and respect the respondent’s time by indicating how long the survey might take at the beginning.

Conclusion:
An effectively designed survey is a powerful tool in the business decision-making process. By adhering to these best practices, you’ll maximise response rates, enhance data accuracy and ultimately gain more valuable insights. 

Remember, the goal isn’t just to collect data, but to collect meaningful data. Effective question design is pivotal to achieving this outcome.


by Michael Wagstaff 8 April 2025
The huge volume of data available through consumer comments, reviews and surveys can make cutting through the noise difficult. In this article we discuss how text analytics combined with human expertise can uncover the insight.
by Michael Wagstaff 10 March 2025
Market research agencies are going all in on AI based models to generate next level consumer insight. But are these just more illusion than substance?
by Michael Wagstaff 3 March 2025
With the online survey already on the ropes due to poor quality, has data science finished it off?
by Michael Wagstaff 24 February 2025
Research agencies are pinning their futures on AI. Are they right to do so or are we missing trick by ditching the human?
by Michael Wagstaff 12 February 2025
Online surveys suffer from fake, ill considered and unrepresentative responses. What can be done to improve their reliability? Triangulation is the key.
by Michael Wagstaff 11 February 2025
With so many agency panels riddled with fake respondents resulting in poor quality data, are we witnessing the end of the online survey?
by Michael Wagstaff 6 February 2025
With the January transfer window closed, we run our predictive model to work out the probabilities of where each team will finish in the final Premier League table.
by Michael Wagstaff 5 February 2025
In this latest article in our series on the power of text analytics we look at how sentiment analysis can be used to really understand what customers think about product offerings.
by Michael Wagstaff 23 January 2025
The true value of review sites lies in going beyond the stars and analysing what reviewers are actually saying.
by Michael Wagstaff 17 January 2025
Start making sense of customer review and feedback data by using text analytics. In the first of a series of articles we discuss how it can help your business.
Show More