Understanding & applying A/B testing: What really matters in practice
Once upon a time, a company was faced with the following challenge: to improve its website and optimize the user experience...
PostHog evaluations
PostHog Tracking Table of Contents In a nutshell Connect your PostHog web analytics account with Varify and analyze your experiments directly with the event and click metrics from PostHog. The events appear in the Varify report about 3-4 minutes after they are triggered on your website. How to use PostHog tracking data Step 1: Activate the PostHog integration The [...]
Confidence interval in A/B testing: The underestimated variable for valid results
In the fast-paced digital era, A/B testing has established itself as a crucial tool in marketing. They enable us to test website variants, advertising messages or even...
Automatic GA4 tracking integration
Automatic GA4 tracking integration With automatic GA4 tracking integration, a new GTM container is created which sends the Varify experiment events to GA4. Table of contents Short & sweet In the Tracking Setup Wizard, you have the option of having the tracking setup performed automatically. The setup can be carried out completely automatically, but requires manual action if [...]
Hybrid A/B tests: The golden mean between client-side and server-side testing?
A/B testing is an integral part of data-driven optimization teams. However, not every team has the same requirements and not every method suits every organization. While marketing teams often want to test visual changes quickly, development teams require deeper intervention in the backend. How to implement tests technically is therefore a strategic decision in advance: client-side, server-side or hybrid? In this article we compare [...]
Shopify - Test shipping costs
Shopify - Perform shipping cost test with Varify.io Table of contents In a nutshell To find out which shipping costs your products achieve the highest conversion or the best contribution margin, you can perform shipping cost tests in Shopify. To do this, add an additional variant filter to the products to be tested. You assign a new shipping profile to the respective variants with the [...]
Troubleshooting / FAQ
Troubleshooting / FAQ Experiment start and delivery Visitors are redirected to other variants during a session / after accepting cookies Prevent endless loops in URL split tests Experiments cannot be started Pages flickering - flickering effect Editor problems Content Security Policy (CSP) errors in the Console Editor or preview variants do not load Experiment or variant cannot be [...]
Experiments cannot be started
Experiments cannot be started With an active Google connection, an audience is created in GA4 for each variant, including the original, when an experiment is started. If the creation fails, the experiment will not start and an error message will appear. In this case, check the following points: Google disconnected If your experiment does not start, it could be due to the [...]
No results link after experiment start
No "Results" link after experiment start If you have selected reporting in Varify in the tracking setup, a "Results" link will appear after starting the experiment, which will take you directly to reporting. If the link does not appear shortly after the start, this is usually because your connection to Google is disconnected. Only if the connection to your [...]
Visitors change the variants within an experiment
Visitors change the variants within an experiment If you notice that a different variant of the same experiment is displayed than before during a page visit - or even on a return visit - this can have various causes. The most common causes are The Tracking Activation Script was not integrated correctly Consent Management Platform blocks the Varify Script [...]