Growth that compounds

A marketing attribution model needs a counterfactual

A marketing attribution model can describe observed touches. It cannot prove incremental demand unless the decision includes a credible counterfactual.

1,069 words 5 min read 5 references  readers

Management summary

A marketing attribution model answers a question about observed paths: which touchpoints were present before a conversion, and how should credit be assigned among them? Budget owners often ask a different question: what would have happened if the touchpoint had not occurred? The second question needs a counterfactual. This article separates last-click, multi-touch, aggregate and experimental measurement, then shows how to give each instrument the decision rights it can support. It explains why high attributed return can coexist with little incremental demand, why model sophistication does not remove selection, and how to build a marketing measurement review that leaves observed credit and causal lift in different columns.

Keywords: Marketing attribution model · Marketing attribution · Incrementality testing · Budget measurement

On this page

A marketing attribution model can describe observed touches. It cannot prove incremental demand unless the decision includes a credible counterfactual.

That is the boundary between “which touch received credit?” and “which outcome would not have happened without the touch?” Both questions matter. They are not answered by the same instrument, even when the dashboard displays both as return on spend.

Why must commercial attribution shift from touchpoint tracking to causal incrementality?

Last-click attribution asks which recorded touchpoint was closest to the conversion. Multi-touch models distribute credit across the observed path. Aggregate models relate spend and outcomes over time. A holdout or lift test compares treated and untreated units under a designed intervention.

The first three can be useful descriptions. The fourth is designed to estimate a counterfactual under the tested conditions. The practical mistake is not using an attribution model. It is giving its output the decision rights of an experiment.

QuestionInstrumentWhat it can supportWhat it cannot support alone
Which touch was recorded?Last click or rule-based attributionPath description and operational reportingCausal lift
How should observed credit be shared?Multi-touch modelA chosen allocation of observed creditWhat would happen without the touch
How did aggregate demand move with spend?Marketing mix modelingScenarios under model assumptionsA clean channel experiment
What changed relative to no treatment?Holdout, lift or ghost-ad designIncremental outcome under the test conditionsUniversal transfer to every segment

Table 1Observed credit is not incremental lift

The model earns its authority from the question it was designed to answer.

Source: Author's synthesis of the cited advertising measurement literature.

View exhibit page

Why do high reported ROAS metrics frequently disguise inframarginal organic baseline demand?

People who are already close to buying are more likely to search, visit a site, click an ad and convert. A model that sees the path can mistake the buyer’s intent for the effect of the touchpoint. The touchpoint was present. The conversion may have happened anyway.

Blake, Nosko and Tadelis’ paid-search experiment is useful because it tests the counterfactual by turning off non-brand search in selected markets. The result is not a universal rule about search. It is a demonstration that observed activity can overstate incremental response when the audience contains buyers who were already likely to purchase.

Lewis, Rao and Reiley show the same problem from the measurement side: correlated online behaviour can make advertising look more effective than it is. Lewis and Rao then show why even a real incremental effect can be expensive to estimate when the outcome is noisy.

The conclusion is not that attribution is useless. It is that attribution and causality should sit in separate columns. The incrementality illusion is the deeper reading of the evidence. This article is the shorter operating rule: do not let observed credit set a causal budget without a counterfactual.

How should marketing leadership assign distinct decision rights to attribution tools?

An attribution model can help a team find missing tracking, detect a broken campaign path, identify which touchpoints are associated with a segment and organise a conversation with sales. It can also be useful for allocating operational attention within a known budget.

It should not, on its own, decide whether to increase a channel, claim a return that will survive a budget cut or compare one campaign’s causal productivity with another’s.

The decision rights should be written down before the dashboard is opened.

OutputAllowed decisionRequired companion
Observed touch volumeFix tracking, routing or creative coverageA clear statement that the output is descriptive
Attributed conversion shareCompare observed paths inside the same reporting systemA test or bound before reallocating causal budget
Modelled channel contributionRun scenarios and identify sensitive assumptionsCalibration data outside the model
Incremental liftScale, hold or stop under the tested conditionsScope note for segment, period and intervention
Payback and contributionSet a cash or margin ceilingCohort economics and cost boundary

Table 2The marketing measurement decision rights

A measurement system becomes safer when every output has a named decision boundary.

Source: Author's operating framework. The companion link is the evidence-over-anecdote article.

View exhibit page

How can commercial teams construct an empirical counterfactual before reading reporting dashboards?

The smallest useful review asks four questions:

  1. What is the unit that could have been treated or withheld?
  2. What outside event would move both treated and untreated units?
  3. What outcome is measured, and over what window?
  4. Which decision changes if the observed credit is not incremental?

The answer may be that a test is too small or too expensive. That is still useful. It moves the decision to a cash-payback or contribution-margin rule instead of allowing a precise-looking attribution number to impersonate evidence.

Evidence over anecdote makes the same request in a broader form: write down what a number would have to survive before it is used. A marketing attribution model should survive the loss of its most convenient interpretation.

The final question belongs in the operating review: what would we have seen if the campaign had not run? If the answer is only “a lower attributed number,” the model has not yet earned the right to answer a budget question.

Evidence base. The analytical frame also draws on these additional sources: Johnson et al. 2017. The links identify the exact works; they support the mechanisms and boundary conditions discussed here, not every claim in isolation.

References

  1. Gordon, B. R., Zettelmeyer, F., Bhargava, N., & Chapsky, D. (2019). A comparison of approaches to advertising measurement: Evidence from big field experiments at Facebook. Marketing Science, 38(2), 193–225. https://doi.org/10.1287/mksc.2018.1135
  2. Blake, T., Nosko, C., & Tadelis, S. (2015). Consumer heterogeneity and paid search effectiveness: A large-scale field experiment. Econometrica, 83(1), 155–174. https://doi.org/10.3982/ECTA12423
  3. Lewis, R. A., Rao, J. M., & Reiley, D. H. (2011). Here, there, and everywhere: Correlated online behaviors can lead to overestimates of the effects of advertising. Proceedings of the 20th International Conference on World Wide Web, 157–166. https://doi.org/10.1145/1963405.1963431
  4. Lewis, R. A., & Rao, J. M. (2015). The unfavorable economics of measuring the returns to advertising. The Quarterly Journal of Economics, 130(4), 1941–1973. https://doi.org/10.1093/qje/qjv023
  5. Johnson, G. A., Lewis, R. A., & Nubbemeyer, E. I. (2017). Ghost ads: Improving the economics of measuring online ad effectiveness. Journal of Marketing Research, 54(6), 867–885. https://doi.org/10.1509/jmr.15.0297

Pass it on

Share this essay

If it was useful to you, it is probably useful to someone on your team.

Download as PDF

A complete document: title page, contents, sources, and the citation on the last page.

Sinan Isoglu

About the author

Sinan Isoglu, MBA (Quantic)

Commercial growth leader, lecturer and doctoral researcher

Sinan Isoglu is a commercial growth leader, lecturer and doctoral researcher. His work spans go-to-market, pricing and revenue operations; his doctoral research at EM Normandie examines sales and marketing integration after cross-border M&A. He lectures on marketing and growth at IU International University of Applied Sciences.

Credentials

  • Doctoral researcher, EM Normandie Business School
  • MBA, Quantic School of Business and Technology
  • Lecturer, IU International University of Applied Sciences

Writes on

  • Go-to-market
  • Pricing
  • Revenue operations
  • AI in commerce
  • Cross-border growth

The track

The work behind this question.

This piece sits in the commercial track: the operating problems behind growth, pricing and revenue systems.

Comments

Join the thinking.

Comment on the piece, or select a passage above to quote it directly.

Leave a comment

Comments are read and approved personally before they appear. Your name and comment are stored for publication. See the Privacy note.