A/B Test - Significance Calculator
You have performed an A/B test? Very good!
Now we need to check whether the results are statistically significant.
With our Significance calculator you can easily calculate the conversion rate, the uplift and of course the significance of your A/B test.
You have performed an A/B test? Very good!
Now we need to check whether the results are statistically significant.
With our Significance calculator you can easily calculate the conversion rate, the uplift and of course the significance of your A/B test.
When is the result of my A/B test significant?
When A/B testing your website, the goal, of course, is for the customized version to perform better than the original. To ensure that this improvement is not simply based on chance, it is necessary to perform a significance test.
To do this, simply enter the visits and conversions of the original (A) and the variant (B) into our calculator. Furthermore, you determine the confidence level.
The confidence level indicates in percent how certain we can be that our statistical estimates are correct and thus significant.
For example, if you choose a confidence level of 95%, the calculation is considered significant if at least a confidence level of 95% is achieved.
Example of a significant A/B test:
In our example, the original (A) with 85000 visitors and 3326 conversions has achieved a conversion rate of 3.91%.
Variant (B) achieved a conversion rate of 4.10% with 83000 visitors and 3403 conversions. This means an uplift of 4.78%.
The confidence level exceeds our condition of 95%. Thus, our A/B test can be classified as correct with a probability of 97.47% and is therefore significant.
In our example, the original (A) with 85000 visitors and 3326 conversions has achieved a conversion rate of 3.91%.
Variant (B) achieved a conversion rate of 4.10% with 83000 visitors and 3403 conversions. This means an uplift of 4.78%.
The confidence level exceeds our condition of 95%. Thus, our A/B test can be classified as correct with a probability of 97.47% and is therefore significant.
Deeper information on significance calculation
Conditions for the calculation
- Number of Control Visitors (A) and Variation Visitors (B):
One price - unlimited A/B testing at Varify.io
Your perfect alternative to all A/B testing tools
- Fixed price: 99 € per month - unlimited traffic & unlimited experiments
- Can be used anywhere: Works on any website or e-com platform
- Beginner Friendly: Even easier to use than Google Optimize
- Fixed price: 99 € per month - unlimited traffic & unlimited experiments
- Can be used anywhere: Works on any website or e-com platform
- Beginner Friendly: Even easier to use than Google Optimize
No credit card required
DE 
EN 
PT 
IT 
TR 
ES 
FR