Quotas and Recruitment: Form a Useful Sample for the Question

Recruiting people for a survey involves two decisions: who has relevant experience to answer and how the necessary profiles will be distributed in the sample. Quotas help with composition, but they don't correct a poorly designed screening nor do they guarantee representativeness by themselves.

Quotas and recruitment start with experience

Imagine a fictional survey about expense approval in companies. The relevant audience might include those who request reimbursement and those who approve requests. These groups know different parts of the process.

Ask about recently performed actions and actual responsibilities. A job title doesn't guarantee experience with the task. Similarly, someone without a managerial title might be responsible for approval.

Avoid revealing in the invitation all the answers that make a person eligible. Screening needs to identify suitability without teaching how to pass the filter.

Differentiate three limits

The plan's response limit defines the platform's usage capacity. The study's quota organizes how many participations or profiles will be accepted according to its configuration. The sampling plan determines the evidence needed to answer the question.

These three things are not interchangeable. On UXTap, the Free plan offers 1 experimentation study and 50 responses per month, no card required. Ending or deleting this study does not free up a new slot. Recruitment is contracted separately.

Don't choose a sample just to fill the available quota. Exploring difficulties in one profile and comparing proportions between several profiles require different planning.

Configure quotas that match the analysis

In the expense example, the team might want to ensure the presence of requesters and approvers. Quotas should reflect this intention and the feasibility of recruiting each group.

On UXTap, there is a total quota and quotas by compatible single-choice question options. Check which question identifies the profile and test each option before data collection.

If a person performs both roles, decide how they will be treated. Forcing a classification without considering this situation can produce unclear groups.

Plan the path for those who don't participate

People outside the profile, with a filled quota, or with a completed study need to receive a coherent termination. In panel surveys, the return should also correspond to the participation outcome.

UXTap allows configuring identification by token and return destinations for completion, disqualification, and quota. Use the addresses provided by the recruiter and validate the journey with test records.

Don't interpret every termination as abandonment. Disqualification by profile and lack of a slot are different situations from giving up during a task.

Review quality without inventing filters afterward

Before analysis, define how technical problems, identified duplicates, and responses without useful content will be handled. Keep a record of exclusion reasons and maintain consistent criteria.

A critical response is not a sign of low quality. A short response can also be sufficient for a given question. Evaluate the contribution in relation to what was asked.

When in doubt, consult the session and context. Avoid creating retrospective rules just because some results contradict the team's hypothesis.

Build a screening based on recent activities

In the fictional expense survey, asking only about the job title might include people who do not perform the investigated activity. Prefer to identify what they have done: requesting a reimbursement, checking documents, or approving an expense within a period relevant to the study. The chosen window should be explicit and compatible with the actual frequency of the task.

Some people perform more than one role. Decide how this overlap will be treated before configuring the quotas. You can investigate the most recent activity or define a primary profile for that segment. Do not force the person to choose a professional identity that does not describe their work just to simplify the analysis.

Avoid revealing in the question which answer guarantees participation. A screening that states “we need approvers” can encourage a convenient choice. Use understandable alternatives, without promising approval for a specific answer, and check the coherence between reported experience and the task that will be presented.

Maintain a field tracking board

Record by group the composition objective, invitations sent when this information is available, initiated participations, and usable completions. Also separate disqualifications, quota terminations, and technical problems. These numbers represent different stages and should not be used as synonyms.

If one group progresses quickly and another has recruitment difficulties, examine the reason before relaxing the criteria. The activity might be rare, the invitation might be unclear, or the channel might reach the wrong audience. Changing the participant definition in the middle of data collection changes the question the sample can answer.

Document inevitable adjustments with date and justification. If the survey starts accepting people with other experience, preserve this information in the analysis. Do not use a filled goal as proof that the original composition was achieved when the rule changed to allow filling.

Rehearse terminations with the recruiter

Use test participants to go through completion, disqualification, and filled quota. Check the identification accompanying each return and agree on what result the recruiter expects to receive. Avoid discovering after data collection begins that a person finished the task but received a message incompatible with their situation.

Differentiate group quota and platform usage limit in operational communication. The quota organizes the survey's composition. The plan defines product usage conditions. A recruiter needs to understand participant termination; the workspace owner needs to monitor contracted limits. Mixing these decisions makes it difficult to solve problems during fieldwork.

Afterward, review the effective composition and losses. A sample with filled quotas does not automatically become representative of the entire population. The invitation channel, availability to participate, and required experience continue to delimit the reach. Relate this reading to the research plan and present conclusions proportional to the design implemented.

Close data collection with the actual composition

When delivering the survey, show the profiles obtained, participation criteria, and limitations. If a quota remained incomplete, explain how this affects the interpretation.

To start, write down who needs to be in the survey and what comparison will be made. Configure screening and quotas in UXTap, test terminations, and align returns with the recruiter. The quality of the sample depends on this set of decisions, not just on reaching a final number.

Test screening paths with the conditional logic guide. In the results resources, also plan how to present the actual composition of the data collection.

Frequently asked questions about quotas

Should I create a quota for every characteristic of the audience?

No. Prioritize characteristics necessary for the decision or planned comparison. Requiring too many cross-tabulations can make data collection difficult and produce small groups. Record which differences need to be represented and which will only be described, avoiding transforming every registration field into a recruitment requirement.

Can I replace a difficult group with a similar one?

Only by acknowledging that the segment has changed. People with similar roles may have different accesses, responsibilities, and experiences. Re-evaluate if the new composition still answers the question and document the change. Do not present the substitute group as if it were the originally anticipated audience.

Does deleting the Free study free up another survey?

No. The Free plan allows for one total experimentation study; deleting or ending this study does not renew the slot. This limit is separate from monthly responses and recruitment. Plan the initial test to learn about tool usage without confusing the plan's condition with the methodological sample size.

Create your UXTap account to prepare your first study.