The success of your survey starts with the kind of questions you ask. Bad survey questions make it difficult for you to gather data objectively while good survey questions allow you to collect insightful data that can be used during a systematic investigation.
Many times, it can be difficult to separate bad survey questions from good survey questions and this poses a huge challenge in research. In this article, we will differentiate bad survey questions from good ones to help you create better surveys in the future.
A good survey question is one that allows you to gather clear, unbiased responses from survey respondents. With a good survey question, you can gain clear insights into the thoughts, experiences, and expectations of your target audience for better decision-making.
For instance, in market research, good survey questions will provide you with enough information on the buyer’s journey and how well your brand interacts with them across different touchpoints. This would help you optimize your product to suit your needs.
A Likert scale question is a type of survey question that allows you to measure a respondent’s disposition towards specific assertions in a research context. With a Likert scale question, you can find out the extent to which respondents agree or disagree with different statements in your research.
Likert scale questions are made up of 3,5 or 7-point ranking scales that allow you to indicate the degree to which you agree with the statement in question. All Likert scale questions have a mid-point that caters to neutral responses; that is, respondents who neither agree nor disagree with the assertion.
Likert scale questions are one of the best methods of collecting quantitative data in research. A Likert scale question can be unipolar or bipolar. While a unipolar Likert scale question has one pole and measures one quality, a bipolar Likert scale has two opposites and focuses on two qualities.
1. How satisfied are you with our customer experience?
2. I enjoyed using this product.
It is important to understand what makes a Likert scale question one of the best examples of a good survey question. Likert scale questions are really easy to create and they are simple and straight to the point without complexities.
Also, with little or no biases, they help you to capture respondents’ emotions, thoughts, and emotions which translates to valid research data. Likert scale questions also account for variations in people’s thoughts and experiences and represent these adequately.
A dichotomous question is a type of survey question that has only two possible options which are typically parallel; that is, true/false, yes/no, agree/disagree. Survey respondents cannot provide neutral responses to dichotomous questions as there is no allowance for such.
Dichotomous questions are simple, direct, and straight to the point, and they are best used when you need to collect definite responses from your audience. However, because of their direct nature, dichotomous questions can be limiting in nature and prevent respondents from providing enough information in research.
1. Do you enjoy using our product?
2. Was this article helpful?
3. Our customer support team was very responsive.
A multiple-choice question is a type of close-ended question that provides respondents with a fixed set of answer options they can choose from. Depending on the multiple-choice question, respondents are allowed to choose one option or multiple options that they agree with.
Every multiple-choice question is made up of 3 parts which are the stem, answer, and distractors. The stem is the question, the answer is the appropriate response to the question while the distractors are other options listed in the MCQ.
1. What is your gender?
2. Which of these would you prefer for breakfast?
A bad survey question is one that prevents respondents from providing objective answers in research. These questions usually contain several biases that make it difficult for survey respondents to communicate their true thoughts, preferences, and experiences.
Many times, having a poor survey response rate, high survey dropout rate, and subjective research outcomes are indicators of bad survey questions in research. To prevent these, you must know the features of bad survey questions so that you can work on avoiding them.
This is a type of survey question that addresses more than one issue but provides for only one response. It is also known as a double direct question because it weaves multiple issues into one and expects respondents to address these issues with only one answer.
Double-barreled questions are problematic in surveys because they can be confusing and misleading. Weaving multiple assertions into one question that demands a single response makes it nearly impossible for respondents to agree to one assertion and leave out the others.
a. Do you find our product interesting and useful?
b. How satisfied are you with our customer service and service delivery?
A loaded question is a type of question with inherent biases. It typically contains a controversial assumption that typically presupposes that the respondent is guilty of a specific action or behavior. Many times, the assumptions in a loaded question are unverified and this is what makes them problematic.
A loaded question is a bad survey question because it imposes unverified implicit or explicit assumptions on the respondent. This makes it difficult for the respondent to freely communicate his or her thoughts and experiences about the issue at hand.
a. Have you stopped smoking before the incident happened?
This question assumes that the respondent smokes which may not be the case. Providing a yes/no answer to this question already confirms the intrinsic bias of the respondent's smoking habit.
b. Do you think we should report this criminal?
This question presupposes that the person in question is a criminal. Whether you answer yes/no to this question, it still confirms the existing bias.
This is a type of survey question that subtly prompts the respondent to provide answers in line with predetermined responses. With a leading question, the researcher already knows what he or she wants you to say so they craft the question to make you respond exactly how they want.
A leading question is a bad survey question because it leads to survey response bias and typically boxes respondents into a corner. This is because it is extremely suggestive. Leading questions can be based on assumptions, interconnected statements, coercion, or direct implications.
a. How well did our excellent services meet your needs?
b. If you enjoyed this event, would you like to check out our other activities?
4. Negative Questions
A negative question is a type of survey question that requires a negative answer for a positive response and a positive answer for a negative response. It is a bad survey question because it is quite complex and can confuse respondents.
As we’ve said earlier, the best kinds of survey questions are simple, straight to the point, and easy to understand. Having a negative question or double negative question in your survey defeats this purpose and can affect the quality of information you gather from your survey.
a. I don’t think your product is not too expensive.
b. I don’t enjoy using this product.
5. Vague Questions
A vague question is one that is uncertain or unclear. This type of question does not seek a specific response and it is usually too broad or poorly defined. Because vague questions are not restricted to a specific context, they always result in generic responses that are not useful in research.
Vague questions almost defeat the purpose of your survey because they make it difficult for you to gather valid data. To avoid vague questions in your survey, ensure that your questions are crafted in a way that they are easy to understand, specific, and well-defined for your audience.
Examples of Vague Questions in Surveys
a. Do you think people enjoy using our product?
b. Do we have the best product in the market?
With Formplus, you can say goodbye to bad online surveys. Our form builder is easy to use and has more than 30 form fields that help you collect and process different types of information without stress. Follow these easy steps to create good online surveys using Formplus.
1. Create your Formplus account for free on www.formpl.us/signup. If you already have a Formplus account, simply login to access your dashboard.
2. On your dashboard, click the "create new form" option to start working on your online survey. Alternatively, you can choose any of the templates and edit them to suit your needs in the form builder.
3. The Formplus builder has more than 30 fields that you can add to your survey easily. All you have to do is drag preferred fields from the field section into your form. You'd find the field section on the left corner of the form builder.
4. You can use the multi-page option to break your survey into different pages and sections. This makes your survey layout neater and more appealing.
5. After adding the fields you want, save the form to automatically access the customization section of the form builder.
6. Use the form customization options to change the appearance of your online survey. You can add background images, your organization's logo, and also change the form font and layout as you wish.
7. Copy the form link and start sharing your online survey. Formplus has multiple form sharing options that take the stress of you by making it easier for you to administer your survey.
8. For example, you can send out email invitations to respondents or use our social media direct sharing buttons to share your form with your online audience.
9. Don't forget to monitor the form analytics dashboard to gain insights into the survey response rate and other important numbers.
To get the most out of your survey, of any kind, you must start with the right type of questions. It doesn’t matter whether you have the best survey design or the most effective sharing platforms; bad survey questions will ruin your data collection process.
A lot of effort goes into surveys and data collection and this is why you must strive to get them right at the first trial. Knowing the difference between bad survey questions and good survey questions takes you even closer to having an effective data collection process.
Begin your data collection with a tool that provides good survey questions in free pre-designed templates.
You may also like:
Different socio-demographic factors affect how and why a customer chooses one product over the other. Maybe they do not have enough money ...
A pulse survey works exactly as its name suggests—it's a quick check-in method to know how employees or customers feel about a number of ...
To keep up with technology, you need to monitor trends and patterns among users in specific contexts constantly. Whether in the workplace ...
What is a Guttman Scale? The Guttman scale is one of the three unidimensional measurement scales. It tests how a person responds to a ...