Growth & Marketing

What's the minimum data I need before I trust that a paid campaign is actually working?

A starting point

Roughly 30 to 50 conversions per variation before you read anything into a result, and enough spend that you're not judging on 3 or 4 lucky sales. Below that, what looks like a winning ad is usually just noise. Give a campaign at least a week or two and a few hundred clicks before you call it dead or alive.

Go deeper

Hand-picked from around the web, each with a note on why it earns your time.

3 resources 2 link-checked Watch Read Use

Watch

▶️ Video
✓ Link checked Free Beginner

Why we picked it Before you judge a paid campaign, you need to know the platform spends the first stretch guessing, and this video from a working media buyer breaks that down plainly. It explains why cost per result swings wildly early and why the algorithm needs a batch of conversions (around 50 in a week) before delivery settles. Watch it so you do not kill an ad set that was simply still learning.

Facebook Ads Learning Phase Explained

On YouTube by Hernan Vazquez

Facebook Ads Learning Phase Explained
  • New ad sets enter a learning phase where the platform is making exploratory bids, so early cost per result is unreliable by design.
  • Meta wants roughly 50 optimization events in a rolling week before delivery stabilizes and the numbers mean something.
  • Editing budget, targeting, or creative mid-flight restarts learning, so constant tweaking keeps you stuck reading noise.
Watch on YouTube youtube.com →

Read

📄 Article
Free Intermediate

Why we picked it Most founders call a paid campaign a winner or loser off a handful of clicks, and this piece walks through exactly why that read is usually noise. It puts real numbers behind the question: what baseline conversion rate, what minimum detectable effect, and how many conversions you need before the result means anything. Treat it as a starting point for setting your own threshold before you launch, not after you are staring at the dashboard.

Calculating Sample Size in A/B Testing: Everything You Need to Know

From GuessTheTest by Deborah O'Malley

  • Decide your required sample size and minimum detectable effect before the campaign runs, so you are not tempted to stop early on a lucky day.
  • Rough reliability wants thousands of visitors and hundreds of conversions per variant, far more than the trickle most early tests collect.
  • Let a test run at least two full weeks to cover normal weekday and weekend swings, and avoid peeking and calling it early.
Open guessthetest.com →

Use

🛠️ Tool
✓ Link checked Free Beginner

Why we picked it When one ad beats another, this free calculator tells you whether the gap is real or just luck. You plug in visitors and conversions for each version and it returns the probability that the difference holds up, no spreadsheet or stats background needed. Use it as a gut check before you shift budget onto the ad that only looks like the winner.

A/B Test Statistical Significance Calculator

From VWO by VWO

  • Enter visitors and conversions for control and variant, and it reports the chance the difference is genuine rather than noise.
  • A small lead on small numbers usually comes back as not significant, which is the honest answer you want before spending more.
  • It is free and needs no signup, so you can sanity-check every head-to-head test as you run it.
Open vwo.com →

People also ask

Should I even be running paid ads at this stage? Only if you already have retention and a clear sense of what a customer is worth; otherwise you're paying to fill a leaky bucket. Most early startu... Beginner 2 resources → How do I know if my paid ads are actually profitable? Compare customer acquisition cost to the contribution margin a customer generates, and demand payback inside a few months (or a single order for D2... Intermediate 2 resources → What makes a paid ad actually convert? The creative does 80% of the work, not the targeting: a scroll-stopping hook, one clear promise, and a landing page that keeps the exact promise th... Beginner 2 resources → How do I pick which paid channel to start with? Match the channel to how people already look for what you sell: intent-driven search for problem-aware buyers, feed-based social for discovery and ... Intermediate 2 resources → How much budget do I need to test a paid channel properly? Enough to get a statistically real read, usually a few hundred conversions per channel before you judge it, not fifty dollars over a weekend. Set a... Intermediate 2 resources → How do Indian D2C brands keep paid acquisition sustainable as CACs rise? Winning Indian D2C brands stop renting attention and build owned media, content engines, and community so they aren't fully dependent on Meta and G... Intermediate 2 resources →