All articles

Recruitment / UXTap Journal

Screen participants without revealing desired answers

Review how to craft screening questions about recent behavior and balanced alternatives, avoiding the revelation of desired roles or usage ranges.

Different colored dots passing through a filter.

When screener questions inadvertently signal desired answers, participants might try to fit a perceived profile. This can lead to biased responses, potentially affecting the usefulness of your research findings. Crafting neutral questions helps identify individuals whose natural behaviors align with your study's needs, allowing for more relevant insights.

Ask about recent behavior

Focus on participants' actual past behaviors rather than hypothetical future actions. This approach can reduce speculation, allowing your team to inspect more relevant experiences. While not guaranteed truthful, asking about recent actions within a clear timeframe, like 'In the last month,' can provide a clearer picture of habits. Always include an option for 'I cannot remember' to avoid forcing a guess, which helps in understanding actual recall.

Offer balanced alternatives

Provide a range of neutral, non-overlapping response options to avoid leading participants. For example, if seeking users of a banking app, a hypothetical question could be: 'In the last three months, how often did you use a mobile app for banking? (a) Daily, (b) A few times a week, (c) A few times a month, (d) Rarely, (e) Never, (f) I cannot remember.' This approach allows participants to select an answer without feeling pressured, which helps reveal a broader range of actual behaviors.

Keep research purpose general

Explain the general purpose, activities, data use, and participation conditions. Avoid announcing the exact combination of answers that makes someone eligible. For example, describe research about banking services without promising that selecting daily use secures a place. The invitation must remain truthful. If specific details could lead answers, review the invitation and screener without omitting information someone needs to decide whether to participate. Neutral screening and informed participation should work together.

Screening best practices

  • Focus on actual past behaviors within a clear timeframe.
  • Offer neutral, non-overlapping response options, including 'cannot remember'.
  • Generalize the study topic, not specific features or eligibility criteria.

Select three screener questions from a past study that might have revealed desired answers. For each, rewrite the question and its response options, focusing on past behaviors, clear timeframes, and balanced alternatives. Record these revised questions in a document, noting how each change aims to reduce potential bias in future recruitment.

Your next discovery begins with a question.

Test an idea, observe the experience and bring evidence to your team.

Create my first study

Free · 1 study · 50 responses/month · no card