- Set one main metric before the sale, compare against a baseline, and read the result after pull-forward effects have settled.
- The cleanest baseline is a holdout group: a share of visitors who do not see the offer. Last year and the weeks before the sale work as a second view.
- Six metrics cover most questions: revenue, orders, average order value, margin, new customer share and returns.
- The guide ends with a report template you can copy. Black Friday 2026 is Friday, November 27, and Cyber Monday is Monday, November 30.
To measure whether a Black Friday campaign worked, set one goal metric before the sale, compare against a baseline that shows what would have happened without the campaign, and read the result only after pull-forward effects have settled. The strongest baseline is a holdout group: a small share of visitors who do not see the offer. Year-over-year and week-over-week comparisons are easier to set up and easier to misread.
Black Friday 2026 is Friday, November 27, and Cyber Monday is Monday, November 30. This guide covers the success definition, the six metrics that matter, three ways to compare, pull-forward effects, a holdout setup with Varify and a report template. For the data quality of an A/B test itself, see the guide linked in the holdout section.
Define success before the sale
A campaign cannot be judged after the fact if nobody wrote down what success means. Agree on these points before the sale starts:
- One main metric. Pick the number that decides: for example revenue per visitor, contribution margin or new customers. A campaign that raises revenue and lowers margin can look good in one metric and bad in the other.
- Guardrail metrics. Name the numbers that must not get worse, such as the return rate or the share of orders with a discount code.
- The comparison. Decide which baseline you use (see below) before you see any data.
- The time window. Fix the start, the end and the date of the final read. Write down who owns the report.
Write the definition in one paragraph and share it with everyone who runs part of the campaign. A fixed definition prevents the habit of picking the metric that looks best afterwards. Add a decision rule in plain words, for example: if the campaign group beats the holdout on the main metric and the guardrails hold, we repeat the format next year; if margin falls, we change the offer.
The metrics that matter
Six metrics cover most Black Friday questions. Define each one the same way in every report.
- Revenue. Total order value in the period. Decide whether it includes shipping and taxes and keep that choice.
- Orders. The number of completed orders. Count each order once.
- Average order value. Revenue divided by orders. It shows whether offers changed the basket size.
- Margin. Revenue minus the costs of goods, shipping and discounts, as an amount and as a share of revenue. It shows whether the extra revenue pays.
- New customer share. Orders from customers who bought for the first time, divided by all orders. It shows whether the campaign reached new people.
- Returns. Returned orders or items as a share of orders. Returns arrive weeks later, so repeat the read after the return window.
Revenue per visitor is a useful bridge between traffic and sales: revenue divided by visitors. It lets you compare periods and groups with different traffic.
Choose the right comparison
Every comparison answers a slightly different question. The table lists the three common ones.
| Comparison method | Strength | Weakness |
|---|---|---|
| Same period last year | Covers the same season and the same calendar, including Black Friday itself. | The shop, the traffic mix, the prices and the market differ from last year. The gap contains much more than the campaign. |
| The weeks before the sale | Close in time and in shop setup. Easy to pull from your analytics. | Normal weeks have no Black Friday demand, so the whole peak looks like a campaign effect. |
| Holdout group | Same days, same market, same shop. The only difference is the offer, so the gap shows the effect of the campaign. | Needs a setup before the start. A small group means a wider margin of error, and some visitors never see the offer. |
The honest answer to “did it work” is the gap against a baseline. Year-over-year and before-after comparisons are fine as a second view. A holdout group is the only one of the three that separates the campaign from everything else that changed on those days.
Watch for pull-forward effects
A pull-forward effect happens when the campaign moves purchases forward in time. Customers who would have bought in October or December buy on Black Friday, usually at a discount. The sale then looks bigger than its net effect. This is a hypothesis for your shop to check, because the size differs by category and customer base.
Three checks make it visible:
- Compare totals over a longer window. Look at revenue from the start of October to the end of December, against the same window in your baseline. A gain on Black Friday paired with a dip afterwards points to pull-forward.
- Look at repeat customers. Check whether customers who bought on Black Friday would have bought within the following weeks.
- Look at the discount share. If orders from existing customers with a discount code grow while full-price orders fall, discounts may have replaced orders at full price.
Plan the final read after the window you chose, for example in January, and give the first read on Cyber Monday as a preliminary result.
Measure with a holdout using Varify
A holdout group is a share of visitors who see the normal shop while everyone else sees the campaign. Compare the two groups over the same days and you see the effect of the campaign itself. Varify can build this with an A/B test or with personalization and an uneven traffic split. Whether you can run a test in peak week at all is covered in A/B testing during Black Friday.
- Set up the split. Build the campaign elements as the variation: banner, prices, badges (see how to test Black Friday banners without a developer). With Prompt-Based Experimentation (PBX), you describe them in plain language in the Visual Editor (“Ask AI”), and the AI builds the variation, writes the code and sets up the experiment, without a developer. See the PBX examples and the PBX docs. Assign a small share of the traffic to the original. That share is your holdout group. Which share is right depends on your traffic, so plan it with the test runtime calculator.
- Target the right visitors. With audience targeting by URL query (UTM), referrer or geography, the holdout can apply to visitors from one email or ad. See audience targeting.
- Measure. Connect GA4 and read revenue, orders and basket value per group. For raw data, Varify offers the BigQuery evaluation and the CSV export (see exporting the results), and Bayes statistics show the remaining runtime. The guide to Black Friday tools for online shops lists the analytics and recording setup to check beforehand.
- Check first. Use the preview link and QA mode to confirm that goals fire for both groups (see quality assurance).
Varify sets no cookies and stores the group assignment in localStorage, so a visitor who returns stays in the same group. Which visitors your analytics tool can count depends on your consent setup, which is a question for your data protection officer. For the data side of an A/B test, read GA4 or BigQuery: which numbers an A/B test can trust.
Your post-Black-Friday report template
Copy this outline into a document. Fill it in on Cyber Monday as a first read, and again after the window you chose.
- Goal and metric definition from before the sale, with the date of the final read
- Period, channels and the offers that ran, with start and end times
- Results for the main metric: campaign group, baseline, gap and margin of error
- Results for the five other metrics and the guardrail metrics
- Comparison against the second view (last year or the weeks before)
- Pull-forward check: totals over the longer window
- What worked, what did not, and what we do differently next year
- Open points: returns still to come, data gaps, owners and dates
Add the screenshots or exports that back each number, and name the data source next to every figure.
Measure your Black Friday campaign with a holdout.
Varify.io: PBX, GA4 integration, Campaign Booster. Compare the group that saw the offer with the group that did not.