A good online research panel can tell you how it checks identity, stops duplicates, catches careless answers, pays people and handles mistakes. Ask seven questions. A provider that answers each one specifically, including what it cannot do, is worth more than one with a headline number.

Use this list on 50heads or on any other provider.

The seven questions

1. How do you check who is answering?

Ask what "verified" means. A verified phone number is not the same as a checked ID, and neither is the same as an established track record.

On 50heads, Tier 1 is a verified mobile number. Tier 2 adds an ID and live-face check. Tier 3 is by invitation after a long record of careful answers.

2. How do you stop one person answering many times?

Ask about phone numbers, identity matching and device checks. Ask how often they re-check.

On 50heads, a phone number can belong to one account, and Tier 1 heads confirm it again monthly if they earned in that month.

3. How do you catch careless answers?

Ask about known-answer questions, timing checks and what happens to repeat offenders.

On 50heads, hidden known-answer questions and timing checks run on every head. Careless patterns lead to review by a person.

4. What do you check about the device?

Ask whether the provider checks that an answer came from a genuine device running its own app.

On 50heads, every answer passes an Apple or Google integrity check, and we reject answers that fail it.

5. How are people paid?

Pay affects who takes part and how carefully. Ask what the share is, whether rates are published and whether you can see them.

On 50heads, heads get 60% of every answer's price, and the rates are public. See what heads earn and does paying people fairly improve research quality.

6. What do you publish?

Ask whether the provider reports its own mistakes, such as appeals received and upheld.

On 50heads, we publish appeals received and upheld each quarter in our transparency note. The first report covers October to December 2026 and is due in January 2027, so there are no figures yet.

7. What can't you do?

Ask what the panel is not suited for. Every panel has limits.

Known limits on 50heads

We would rather you heard them from us:

  • It is one short question at a time, not a multi-page survey.
  • The panel is new. We publish pool size bands per country and tier rather than a total.
  • Targeting traits are what heads say about themselves. We don't check them, except an age band taken from an ID check.
  • Verification reduces fraud. It does not remove it.
  • A preference result shows what this group chose. It is not a population estimate.

Scoring a provider

Give each question a mark:

  • Specific: names the check and how often it runs.
  • Vague: says "real people" or "high quality" with no detail.
  • Missing: doesn't answer.

Most of the value is in the difference between the first two.

Next step

If a short question to verified phones fits your decision, see pricing and try the estimator. It charges nothing. To see the checks in detail, read how we check each answer comes from a real person.