A/B Test - Significance Calculator

More information

Control Visitors:

Control Conversions:

Variation Visitors:

Variation Conversions:

Confidence Level:

You have performed an A/B test? Very good!

Now we need to check whether the results are statistically significant.

With our Significance calculator you can easily calculate the conversion rate, the uplift and of course the significance of your A/B test.

You have performed an A/B test? Very good!

Now we need to check whether the results are statistically significant.

With our Significance calculator you can easily calculate the conversion rate, the uplift and of course the significance of your A/B test.

When is the result of my A/B test significant?

When A/B testing your website, the goal, of course, is for the customized version to perform better than the original. To ensure that this improvement is not simply based on chance, it is necessary to perform a significance test.

To do this, simply enter the visits and conversions of the original (A) and the variant (B) into our calculator. Furthermore, you determine the confidence level.

The confidence level indicates in percent how certain we can be that our statistical estimates are correct and thus significant.

For example, if you choose a confidence level of 95%, the calculation is considered significant if at least a confidence level of 95% is achieved.

Example of a significant A/B test:

In our example, the original (A) with 85000 visitors and 3326 conversions has achieved a conversion rate of 3.91%.
Variant (B) achieved a conversion rate of 4.10% with 83000 visitors and 3403 conversions. This means an uplift of 4.78%.
The confidence level exceeds our condition of 95%. Thus, our A/B test can be classified as correct with a probability of 97.47% and is therefore significant.