Matomo - Results analysis

Matomo - Evaluation of results Table of contents Short & sweet To evaluate your experiments in Matomo, use the segment function. Create separate segments for the original version and the variant and place them next to each other. You can find the instructions for linking Matomo with Varify.io here: Matomo - Integration via Matomo Tag Manager Creating segments To analyze your experiment, you must create segments for [...]

Evaluate custom conversions in explorative reports

Evaluation of custom events in exploratory reports Table of contents Short & sweet To evaluate custom events in exploratory reports, you need to create a custom metric for the event in Google Analytics 4. Not recommended: Evaluating events via conversions in exploratory reports In Google Analytics 4, you can create custom events in the exploratory [...]

Calculate significance

How Varify calculates significance Table of Contents Short & sweet The article explains how Varify evaluates test results with a frequentist method using one-sided chi-square and t-tests to detect significance more quickly. It also explains why longer run times and few metrics - especially for A/A tests - are important to avoid wrong decisions by chance. Calculation [...]

Evaluation of results in GA 4

Evaluation of results with GA 4 IMPORTANT NOTE:The procedure for evaluating results in GA4 has changed slightly. The previous evaluation still works as usual. However, the new procedure is necessary to use the upcoming GA4 evaluation directly in Varify.io. If you have any questions, please contact our support team. Table of contents Short & sweet As soon as you have Varify.io® [...]