Skip to content

A/B Test Calculator

Check whether your A/B test result is statistically significant.

5.0 (1 rating)
Confidence level

Enter your values to see the result.

Uses a two-tailed two-proportion z-test. Decide your sample size before the test starts and do not stop the moment it turns significant, or false wins become likely.

Processing and privacy

Processing varies by tool. Check the instructions for local processing, server requests, external services and any file or request limits before entering sensitive information.

Read the privacy policy

How this calculation works

Understand the method, inputs and limits behind your result.

Report a calculation issue
Formula
Conversion rates = conversions/visitors. Pooled p = combined conversions/combined visitors. z = (pB − pA)/√[p(1 − p)(1/nA + 1/nB)]. The p-value is two-sided.
Variables
  • Visitors A (control)
  • Conversions A
  • Visitors B (variant)
  • Conversions B
  • Confidence level: 90%, 95%, 99%
Units
  • Use the units shown beside each input. Counts and ratios are dimensionless unless labeled otherwise.
Example
5,000 visitors per version with 250 and 300 conversions is a 20% uplift with 97% confidence, which is significant at 95%.
Assumptions
Uses a two-tailed two-proportion z-test. Decide your sample size before the test starts and do not stop the moment it turns significant, or false wins become likely.
Source
ToolzHive calculation guide and calculator implementation. External reference verification is pending.
Last reviewed
Review date not yet recorded.

Share this tool

Found it useful? Send it to a friend or teammate.

Rate this tool

5.0

1 rating

  • 5 stars 1
  • 4 stars 0
  • 3 stars 0
  • 2 stars 0
  • 1 star 0

Click a star to rate this tool

Clear instructions

Find steps, examples and limitations below.

Use online

Open the tool in a supported web browser.

Free to use

No sign-up required. Tool-specific limits may apply.

How to use the A/B Test Calculator

Check whether your A/B test result is statistically significant.

  1. 1 Enter visitors and conversions for version A (control) and version B.
  2. 2 Choose the confidence level you require, usually 95%.
  3. 3 Read whether the difference is significant and the uplift.

Example and practical tips

5,000 visitors per version with 250 and 300 conversions is a 20% uplift with 97% confidence, which is significant at 95%.

Frequently asked questions

What is statistical significance?

It means the difference is unlikely to be random chance at the chosen confidence level.

Can I stop the test as soon as it is significant?

No. Decide the sample size in advance; checking repeatedly and stopping early greatly increases false winners.

  • How to Use A/B Test Calculator

    Check whether an A/B test result is statistically significant. Enter visitors and conversions for both versions to see uplift, p-value and confidence.

Browse all guides

Report an issue

Something broken or not quite right? Tell us and we will look into it.

Accessibility Menu

Personalize your experience. Open with Ctrl+U (Option+U on Mac). Preferences stay in this browser when storage is available.

Move / Hide Widget

Restore at any time with Ctrl+U (Option+U on Mac).

Accessibility statement and help