Skip to main content

Communication

How to run a poll that gets honest answers

Neutral wording, fair options, the right amount of anonymity and a sensible deadline, plus how not to over-read the result once it's in.

By the Asyncbit teamReviewed 7 min read

To get honest answers from a poll, ask one neutral question, give options that cover every reasonable answer without overlapping, hide the running results until people have voted, and make the poll anonymous when people might feel judged for their answer. Then set a clear deadline and read the result with its limits in mind: who voted, and who didn't.

Most dishonest poll results aren't caused by people lying. They come from wording that nudges people toward an answer, options that leave out the real one, and social pressure from seeing how everyone else voted. All three are easy to fix before you post.

Decide what the poll is for

Polls do three different jobs, and each needs a slightly different setup.

  • A decision (“Which date works for the meetup?”). You'll act on the result, so the options must be ones you can actually do, and the deadline matters most.
  • An opinion (“Should the club allow self-promotion posts?”). Wording and anonymity matter most, because people may hold back unpopular views.
  • A temperature check (“How are you finding the training plan?”). The result is rough, and that's fine. Its job is to start a conversation, not settle one.

Write a neutral question

A leading question tells people what answer you want. Read your question as someone who disagrees with you would, and remove anything that pushes.

Biased poll questions and better versions
“Don't you think meetings should be shorter?”
The problem:Leading: signals the expected answer
Better:“How long should club meetings be?”
“Should we move to Sundays so more people can come?”
The problem:Includes an argument for one side
Better:“Which day works best for you?”
“Was the trip fun and well organized?”
The problem:Two questions in one
Better:Ask about fun and organization separately
“How amazing was the new format?”
The problem:Loaded word invites only positive answers
Better:“How did you find the new format?”
“Do you not disagree with the change?”
The problem:Double negative confuses voters
Better:“Do you support the change?”

Write options that cover every real answer

  • Cover the whole range. If you ask about meeting length, include both “shorter” and “longer,” not just two versions of shorter.
  • Don't overlap. “1–2 hours” and “2–3 hours” leaves people who want exactly two hours unsure. Use “under 2 hours” and “2 hours or more.”
  • Balance positive and negative. Two positive options and one negative one quietly pushes the result positive.
  • Include an honest way out when it applies: “No preference,” “Can't make any of these,” or “Other (reply below).” Without one, people pick something at random or skip the poll.
  • Keep the list short. A handful of clear options gets more considered votes than a long list people skim.
  • Mind the order. The first option tends to get a little extra attention. For opinion polls, put options in a natural order (like a scale) or vary it between polls.

When to make a poll anonymous

People answer more honestly when their name isn't attached to an answer that might disappoint a friend, a manager or an organizer. Make a poll anonymous when the question touches on feelings, criticism, money, or anything where a minority view might be awkward to admit. Keep names on when you need to follow up with people, such as who's bringing what to a picnic.

Hide the results until people vote

When people can see a running tally, many drift toward the leading option, or skip voting because “it's already decided.” That's the bandwagon effect, and it can turn a close split into an apparent landslide. Hiding results until someone has voted keeps each vote closer to what that person actually thinks. If your tool can't hide results, avoid commenting on the early numbers yourself until the poll closes.

Pick a sensible deadline

A deadline gets people to vote and gives you a clear moment to act. Match it to the question: a day is plenty for “where shall we eat tonight?”, while a change to how a club works deserves several days so members who check in weekly get a say. Post a reminder shortly before it closes, and say in advance what happens with a tie.

Read the results honestly

  • Look at turnout first. Nine votes from a forty-person group tell you what nine people think, not the group.
  • Remember who votes. People who care strongly are the most likely to vote. Quiet members may feel differently.
  • Don't over-read a close split. A six-to-five result means the group is divided, not that one side won convincingly. Consider a conversation instead of a decision.
  • Separate the poll from the choice. For opinion polls, it's fine to say “this informs the decision” rather than “the poll decides.” Just say so before people vote.
  • Share the result and what you'll do about it. People stop voting in polls that seem to go nowhere.

A worked example

Say a photography club organizer wants to know whether to switch the monthly meetup from Saturday mornings to weekday evenings. The first draft reads: “Saturday mornings are hard for a lot of people. Should we move to weeknights? Yes / No.”

The question argues for one side before anyone votes, and “Yes / No” hides what people actually want. Someone who can't do weeknights but also struggles with Saturday mornings has no option at all. A fairer version:

It's neutral, it covers the realistic answers, it gives people with no preference a way to say so, and it tells everyone what will happen with the result.

A pre-flight checklist

  1. Is it one question, not two?
  2. Would someone who disagrees with you call the wording fair?
  3. Do the options cover every realistic answer without overlapping?
  4. Is there a “no preference” or “other” option if people need one?
  5. Have you chosen anonymity on purpose?
  6. Is the deadline long enough for everyone who should vote?
  7. Have you said what you'll do with the result?

Running polls on Asyncbit

Several of these habits are built into polls on Asyncbit. Every poll has a deadline: it expires after 1 day, 3 days or 1 week, with 24 hours as the default. Results stay hidden until you vote, so nobody sees a running tally before choosing. You can choose to post a poll anonymously so it shows no author; that option is off by default, so switch it on when the topic needs it. Polls also appear in the For you feed alongside posts and questions.

If you want written, considered answers rather than a vote, a question on the Q&A board may suit better. And if your poll is really about a group decision, pair it with the pattern in how to keep a group chat useful so the result doesn't get lost afterwards. For the bigger picture of keeping members involved, see how to build an online community.

The short version

  • Ask one neutral question and check it for leading or loaded words.
  • Give options that cover every real answer, don't overlap, and include a way out.
  • Make polls anonymous when honest answers might be awkward to give with a name attached.
  • Hide running results and set a deadline that suits the question.
  • Read results with turnout in mind, and tell people what you'll do next.

Frequently asked questions

How many options should a poll have?
Usually between two and five. Enough to cover every realistic answer, few enough that people can read them all before voting.
Are anonymous polls more accurate?
For sensitive or critical questions, they tend to get franker answers because people aren't worried about how their choice looks. For simple logistics, names are usually more useful.
Should I vote in my own poll?
You can, but avoid announcing your vote or commenting on early results before the poll closes, since organizers' opinions carry extra weight in a group.
What should I do if a poll ends in a tie?
Decide the tie-break rule before the poll opens, such as a quick runoff between the tied options or the organizer choosing. Announcing it in advance avoids accusations of favoritism.

See it for yourself

Asyncbit is free, with no paid tier and no ads. Everything described here is available from the first day.

Create your free account