How is incrementality different from attribution?

Attribution assigns credit for a conversion to touchpoints based on a model, but it cannot tell you whether the conversion would have happened anyway. Incrementality measures causation directly: it isolates the additional sales the marketing caused by comparing exposed and unexposed groups. A channel can show strong attributed conversions while its true incremental impact is small, because it was capturing sales you would have made regardless. Incrementality reveals that gap.

How do I run an incrementality test?

The common approaches are holdout tests, where you withhold marketing from a comparable group and measure the difference, and geo tests, where you change spend in some regions and not others and compare results. The key is a genuine, comparable control group and enough scale and time to read a real signal. Design the test around one clear question, such as the true impact of a channel, and resist drawing conclusions from too little data.

Is incrementality testing worth it for smaller brands?

It depends on your spend. The more you invest in a channel, the more a wrong read on its true impact costs you, so larger budgets justify the effort of testing. Smaller brands can still apply the thinking, being skeptical that attributed conversions equal caused conversions, and run simple holdout tests where feasible. The principle, measuring what your spend actually causes rather than what it gets credited for, scales down even when full formal testing does not.

Playbook Tracking and analytics

Incrementality testing for DTC brands

Q: What is incrementality testing?

Incrementality testing measures the sales your marketing actually caused, the conversions that would not have happened without it, rather than the sales a channel merely got credit for. You compare a group exposed to the marketing against a comparable group that was not, and the difference is the incremental impact. It answers the question attribution cannot: not who gets the credit, but whether the spend genuinely produced additional revenue.

Attribution tells you which channel got credit. Incrementality tells you which sales your ads actually caused. Here is how to test it, so you stop paying for conversions you would have made anyway.

November 17, 2026 7 min read

Attribution answers the wrong question. It tells you which channel got credit for a sale, but not whether that sale would have happened anyway. A retargeting campaign can show a glowing return while mostly capturing buyers who were going to convert regardless, which means you are paying for sales you already had. Incrementality testing answers the real question: what did your marketing actually cause? Here is how to test it.

Causation, not credit

The difference is everything, and it is the whole point of marketing incrementality as a discipline. Attribution distributes credit across touchpoints by a model, but it is blind to whether the conversion was caused or merely captured. Incrementality measures causation directly: it compares a group exposed to the marketing against a comparable unexposed group, and the difference is the true incremental impact. A channel can look excellent on attributed conversions while its incremental impact is small, because it was harvesting demand that already existed.

Attribution asks who should get the credit. Incrementality asks whether the sale would have happened without you. Only one of those tells you where your money is actually working.

How to run incrementality testing

Holdout tests

Withhold the marketing from a genuine, comparable group and measure the difference in sales against an exposed group. If the exposed group buys meaningfully more, that gap is the incremental impact. If the groups buy about the same, the marketing was not causing much, a result attribution would never have shown you.

Geo tests

Change spend in some regions and hold it steady in others, then compare results across comparable geographies. A geo lift test is a practical way to measure incrementality at the channel or campaign level when individual-level holdouts are hard to run cleanly.

Design around one clear question

A good test isolates one question, the true impact of this channel, this campaign, with a genuine control group and enough scale and time to read a real signal. Vague tests produce vague answers; a sharp question with a clean control produces a number you can act on.

Scale the thinking to your spend

Incrementality testing

Distinguish caused sales from merely attributed ones
Use holdout tests: withhold marketing from a comparable group
Use geo tests: vary spend across comparable regions
Build every test around one clear question and a real control group
Ensure enough scale and time to read a genuine signal
Weight the effort to your spend, bigger budgets justify more testing
Stay skeptical that attributed conversions equal caused conversions

Incrementality is the most honest discipline in tracking-analytics, because it measures what actually happened rather than which model wins the credit fight. For incrementality ecommerce work, that is the difference between scaling a channel and quietly subsidizing it. Paired with clean first-party data and sound attribution, it tells you where your spend genuinely moves the business, so you scale what causes growth and cut what only takes credit for it.

If you are spending heavily on channels whose true impact you are not sure of, designing incrementality tests to find out is exactly the kind of clarifying work a tracking audit can scope.