Check whether an A/B test result is statistically significant. Enter visitors and conversions for both versions to see uplift, p-value and confidence.
About this tool
Check whether your A/B test result is statistically significant.
How to use A/B Test Calculator
- Enter visitors and conversions for version A (control) and version B.
- Choose the confidence level you require, usually 95%.
- Read whether the difference is significant and the uplift.
Worked example
5,000 visitors per version with 250 and 300 conversions is a 20% uplift with 97% confidence, which is significant at 95%.
What is statistical significance?
It means the difference is unlikely to be random chance at the chosen confidence level.
Can I stop the test as soon as it is significant?
No. Decide the sample size in advance; checking repeatedly and stopping early greatly increases false winners.
Explore Webmaster & SEO Tools · More practical guides