Compare versions and segments
Find out if the change really improved.
1 minute read
On this page
Interpret differences using comparable samples.
Purpose
See how a change or audience group affects results.
When to use it
With published versions or groups you need to compare.
Before you start
- Responses in both slices
- Comparable questions
Example
Compare the task on mobile and desktop within the same version.
Step by step
- Fix the context. Open Results and select the version and filters shared by the groups to compare. Same task · Same inclusion criteria.
- Choose comparison. Use version comparison when more than one version exists. For segments, choose device, panel variable or an available answer. Mobile · Desktop.
- Read side by side. Check each column’s sample size and block differences. Read intervals or significance indicators when shown. Small samples create more uncertainty.
- Validate the reason. Open answers and sessions from both groups. Share the filtered link so teammates can reproduce your view. Preserve filters when sharing.
How to read the result
- Columns by segment or version
- Differences interpreted alongside sample size and uncertainty
Cautions and limitations
- A larger number does not prove improvement with small samples or different audiences.
- Changed blocks may no longer measure the same thing across versions.
Continue with the interactive guide
Related guides
Was this helpful?
Is something missing? Write to contato@uxtap.app.