Budget for failed tests or you’ll stop testing

12 Jan 2026 · 2 min
1:41

A marketing practitioner explains how to keep testing alive when experiments fail: budget a fixed portion of your marketing spend specifically for exploration, frame it to leadership as an investment rather than guaranteed revenue, and plan for multiple iterations before deciding to stop. Early failures are fine as long as you're learning.

Chapters

More from Michael

5:33
youtube.com

A/A Testing: How to Check If Your Experimentation Platform Actually Works

2mo ago
youtube.com

How to Actually Check If Your Media Mix Model Is Right

3mo ago
youtube.com

The Continuous Testing Loop That Separates Great Marketing Teams From Average Ones

3mo ago
youtube.com

Why "MMM Is Only a Report Card" Completely Misses the Point

4mo ago
youtube.com

The Difference Between Predicting What Happens and What You Make Happen

4mo ago
youtube.com

How Hierarchical Models Fix One of the Biggest Flaws in Media Mix Modeling

4mo ago
youtube.com

The Difference Between Attribution and Incrementality Explained

4mo ago
youtube.com

Statistically Significant Doesn't Mean Worth the Spend

4mo ago
youtube.com

Plato's Cave and the Lie Your ROAS Is Telling You

4mo ago
youtube.com

Why "Statistically Significant" Results Can Still Be Completely Wrong

4mo ago
youtube.com

How to Actually Test If Your Meta Ads Are Working

4mo ago
See all content