Let’s say you’re at a cafe, and after the chef recommends their new special dessert, the waiter later asks, “You loved our amazing new dessert, right?” This kind of question doesn’t give you room to critically evaluate how you truly feel about it.
The right question in this situation would be, “How would you rate our new dessert?” This allows you to truly evaluate your experience and feelings. The first question, however, nudges you toward a positive response, making it difficult to critique the dessert if it was actually not that great.
Leading questions steer you toward a specific response, often because survey designers expect you to feel a certain way. When designing your own surveys, you need to be cautious of this to ensure you collect the feedback you need, not just what you hope to hear.
Let’s discuss leading questions in surveys and how to avoid them to ensure you collect the feedback you need.
A leading question is structured in a way that assumes and implies an answer.
Leading questions aren’t always very obvious, like the cafe example; sometimes, it’s very subtle. It’s when you ask your users questions like, “Don’t you just hate slow customer support?” It’s easy to ask this because years of customer feedback have told you this, but you’re not giving room for customers to tell you their actual pain points outside of speed.
Leading questions are formed from our biases, so we plant ideas in the minds of the respondents without even knowing, because it’s the answer we expect. The problem with it is that while you will get the answer you hope for, they are not really helping you. For example, let’s say you are carrying out an employee satisfaction survey and you ask leading questions. It won’t help you discover what’s draining their morale, and your workplace structure and policies won’t improve.
The majority of leading questions tend to fall into these categories:
This happens when you’re convinced that respondents are supposed to feel a certain way, so your question presumes their answer. For example, “How often do you enjoy our smoothies?” This assumes your customers enjoy your smoothies. The right question would be, “How often do you order our smoothies in a week?”
This is when you unintentionally coerce an answer from your respondents because you’re asking from a point of bias. For example, “Don’t you agree our prices are fair?” This pressures the respondent to agree with you, because it would make it awkward for them to tell you if they feel your prices aren’t. The right question would be, “How do you feel about our pricing?“
These are questions based on direct implications due to a product, person, or service’s current attitude and your perceived future consequences. For example, “Our competitors have slow service. Do you prefer our fast delivery?” This makes the competitor sound bad when the user may not have a problem with service speed, which can paint you as a malicious competitor. The right way to rephrase it would be, “What do you value most in a delivery service?“
These questions use a statement or a popular opinion to nudge respondents to respond a certain way. For example, “Candidate is unqualified for the position. What are your thoughts?” Even if the statement is true, you didn’t allow respondents to tell you how they feel about the candidate and what makes the candidate qualified from their perspective. The right question would be, “How would you rate Candidate A’s eligibility for the position?” You can then follow up with questions asking them to rate the candidate’s eligibility based on different criteria.
Leading surveys prevent you from collecting the true opinions of your respondents and skew your survey results. Here’s how it plays out:
The truth is, most people don’t intentionally lead respondents to answers. You created the survey because you wanted to hear their opinion, but because you already have some data or are sure of how they would respond, you take away that option to decide.
One of the best ways to spot leading questions is to actively look at questions from the respondents’ perspective and observe if it would make you feel a certain way if you don’t agree with the narrative of the questions (your questions shouldn’t have a narrative in the first place). It’s asking yourself these questions:
Sure, leading questions can help you steer your audience in the direction that you want, but this only works when you’re pitching an idea to them, not when you actually need their opinions.
Leading questions don’t allow you to achieve the main goal of creating the survey: collecting true opinions and feedback. Instead, they reflect your biases that further lead you down the path of poor decisions because you are working with inaccurate data.
Resources: Check out our template bank for well-curated survey templates that avoid leading questions and bias.
You may also like:
Every student knows how important it is to do well in school and have good grades but do all students get good grades? The answer is no....
So many posts on the internet will tell you AI is here to make your life easier, or that you can do anything with AI. Well, they are not...
What Is Pedagogy and Why Does It Matter? It is a method and popular teaching practice involving the strategies, techniques, and...
The average person wants new and impressive results, but we are most likely not open to doing things differently. That’s why you are...