Get your first customers

How do I actually measure whether a launch worked, beyond the vanity upvotes and traffic spike?

The short answer

Traffic and upvotes tell you almost nothing; the questions that matter are how many people did the one action you care about (signed up, paid, replied) and how many were still active a week later. Before you launch, write down the single metric that would make you call it a success, so you're not moving the goalposts to feel good afterward. A launch that brings 30 people who stick beats one that brings 3000 tourists who bounce, and only retention data tells the difference.

Go deeper, your way

20 hand-picked resources, 19 link-checked. Pick how you want to dig in.

▶️ Video
✓ Link checked Free Beginner

Why we picked it YC's David Lieb walks through cohort retention: watching each week's new users and asking how many actually come back. For a very early founder that framing answers the real question, because it shows you can read retention off a handful of early cohorts long before you have scale. Treat it as a starting point for how to look at your first users, not a benchmark you must hit on day one.

How To Improve Cohort Retention

On Y Combinator Startup School by David Lieb ~20 min

  • Cohort retention tracks the fraction of new signups who keep coming back, which you can measure even with small early numbers.
  • A retention curve that flattens (rather than falling to zero) is the early signal of real product-market fit worth chasing.
  • Improving onboarding and targeting the right users beats pouring more people into the top of a leaky funnel.
Open ycombinator.com
▶️ Video
✓ Link checked Free Beginner

Why we picked it The definitive talk that reframes launching from a one-shot event into a repeatable tactic, exactly this category's thesis. YC partner Kat Manalac gives concrete relaunch strategies.

How to Launch (Again and Again)

On YC Startup Library by Kat Manalac (Y Combinator) ~25 min

  • Launching is a continuous process, not a single moment you get one shot at.
  • Most first launches get ignored, that's normal, so relaunch repeatedly.
  • Relaunch around new features, audiences, milestones, and channels.
  • Use tactics like pre-orders and outreach to bloggers without big sponsorships.
Open ycombinator.com
▶️ Video
Free Beginner

Why we picked it A plain-spoken talk on why retention, not the traffic spike, is the number that tells you if what you built is actually working. Good to watch right after a launch, while you still have a fresh cohort to track.

How To Keep Your Users

On Y Combinator Startup School (YouTube) 20 min

  • Retention is the metric that tells you if growth is real or just a leaky bucket
  • Talking to the users who left is as informative as talking to the ones who stayed
  • Small, fast product iterations based on retention data beat big redesigns
Watch on YouTube youtube.com
📄 Article
✓ Link checked Free Beginner

Why we picked it This is the piece that named the problem you are asking about: the difference between numbers that make you feel good and numbers you can actually act on. Eric Ries (the Lean Startup guy) wrote it as a guest post, and it is still the clearest short read on why a traffic spike or an upvote count tells you almost nothing. Treat it as a starting point for deciding which one or two numbers your launch should live or die by.

Vanity Metrics vs. Actionable Metrics

From The Blog of Tim Ferriss by Eric Ries 10 minute read

  • A metric is only useful if a change in it tells you what to do next. Total hits and signup counts almost never pass that test.
  • Cohort analysis (following a group of users through registration, trial, and purchase over time) shows whether your launch actually changed behaviour, or just briefly inflated the top of the funnel.
  • Look at per-customer and per-segment numbers, not one big aggregate, because a healthy total can hide the churn and drop-off that decide whether a launch worked.
Open tim.blog
📄 Article
✓ Link checked Free Beginner

Why we picked it A short, no-nonsense walkthrough of which handful of numbers actually matter at your stage, straight from YC's own coaching material. It's the right first stop if you've never set up a metrics dashboard and don't know where to start.

Key Startup Metrics

From Y Combinator Startup Library 10 min read

  • The right metric changes with your stage, not just your business model
  • Growth rate and retention matter more than absolute totals
  • Pick a small set of numbers you check every week, not a wall of charts
Open ycombinator.com
📄 Article
✓ Link checked Free Beginner

Why we picked it This is the piece that pushes you to write down your success number before you launch, exactly the discipline our answer asks for. It's a quick read on how to pick one goal that's specific enough to actually fail at.

Setting KPIs and Goals

From Y Combinator Startup Library 8 min read

  • Set the target number before the event, not after, so you can't move the goalposts
  • A good KPI is specific and time-bound, not a vague aspiration
  • Review the goal against the actual result honestly, even when it stings
Open ycombinator.com
✍️ Essay
✓ Link checked Free Intermediate

Why we picked it Balfour argues that a big, splashy launch to everyone actually hurts you: it buries the signal you need under noise from people the product was never built for. He lays out a narrower, staged approach (using Superhuman as the case study) that's built specifically to produce a clean read on whether it worked.

How To Launch A Product or Feature To Maximize Growth

From Brian Balfour by Brian Balfour 15 min read

  • A broad launch attracts the wrong users and drowns your real signal in noise
  • Launch to a narrow, well-matched audience first and look for concrete success signals before expanding
  • Word of mouth and long-term engagement, not launch-day spikes, are what a launch should be judged on
Open brianbalfour.com
📄 Article
✓ Link checked Free Beginner

Why we picked it The biggest tracking mistake in an MVP is measuring everything and learning nothing. This Amplitude piece walks you through picking one metric that maps to real customer value and finding the early aha moment that predicts whether people stick around, which tells you the few events actually worth tracking. Treat it as a starting point for focus, not a rule: a small product is still learning what matters, so revisit your metric as you go.

Every Product Needs a North Star Metric: Here's How to Find Yours

From Amplitude by Julia Sholtz

  • A good North Star Metric is a leading indicator of value delivered, not a lagging number like monthly revenue.
  • Find the early aha action that predicts retention (the classic example is Facebook users adding seven friends in ten days) and instrument that first.
  • Choosing one metric and a few inputs keeps your tracking small and honest instead of a dashboard nobody reads.
Open amplitude.com
✍️ Essay
✓ Link checked Free Intermediate

Why we picked it This is the piece nearly every other CAC explainer is quoting from, so go to the source. Skok walks through how CAC, lifetime value, and the payback period actually relate, and gives you concrete targets (aim for LTV at least 3x CAC, and try to recover CAC within 5 to 12 months) so you can set a number before you have any real data. It is dense, but it is the honest founder-level breakdown, not a hype piece.

SaaS Metrics 2.0: A Guide to Measuring and Improving What Matters

From For Entrepreneurs by David Skok

  • Your target is a ratio, not a single figure: lifetime value should be roughly 3x or more of what it costs to acquire a customer.
  • Watch the payback period separately from the ratio: recovering CAC in under a year keeps you from bleeding cash while you grow.
  • Before a single sale you can back into a target CAC from your expected margin and how long a customer is likely to stay.
Open forentrepreneurs.com
📖 Book
✓ Link checked Paid Intermediate

Why we picked it The book behind the "One Metric That Matters" discipline, which is exactly the mindset you need to judge whether a ship worked instead of drowning in vanity numbers. It ties the right metric to your business type and stage, so you know which signal to watch after a launch. Read it as the reference that makes the rest of this list make sense.

Lean Analytics: Use Data to Build a Better Startup Faster

From O'Reilly / Lean Series by Alistair Croll and Benjamin Yoskovitz 440 pages

  • Pick the One Metric That Matters for your stage and business model, and let it settle the "did it work" argument.
  • Vanity metrics feel good but do not tell you a shipped thing is working: draw a line to real behaviour.
  • Match the metric to where you are (empathy, stickiness, virality, revenue, scale), because the right signal changes as you grow.
Open leananalyticsbook.com
📄 Article
✓ Link checked Freemium Intermediate

Why we picked it When people sign up and vanish, the first fork is: did they never hit the moment where the product clicked (activation), or did they hit it and still leave (a deeper product or fit gap)? This piece gives you a concrete way to find that moment for your own product, brainstorm candidate aha actions, then check with data whether they actually cause retention rather than just correlate with it. That test is what tells you which problem you are staring at, so it is a starting point for the diagnosis, not the whole answer.

How to determine your activation metric

From Lenny's Newsletter by Lenny Rachitsky

  • A good activation metric is causal for retention, not just correlated, so run regression and then experiments before you trust it.
  • Find the specific early action that separates users who stick from users who churn, that is your aha moment made concrete.
  • If people activate and still leave, the problem is likely core product or fit, not onboarding, and you fix a different thing.
Open lennysnewsletter.com
📄 Article
✓ Link checked India Free Beginner

Why we picked it The Naukri.com founder, using Zomato as the case study, makes the same case as our answer from an Indian boardroom: valuation headlines and signup counts are not health, profitability and retention are. Worth reading for how bluntly an experienced Indian founder says it.

Startups Must Move Away From Vanity Metrics

From Forbes India by Sanjeev Bikhchandani 8 min read

  • Headline valuations and signup numbers are not the same as a healthy business
  • Profitability, cash flow, and customer retention are the metrics that actually predict survival
  • Discipline in a downturn beats scaling for a quick exit
Open forbesindia.com
📖 Book
✓ Link checked Paid Beginner

Why we picked it The origin text for the modern MVP and validated-learning vocabulary every founder now uses. Read it for the mental model that a startup is a series of experiments, not a single bet.

The Lean Startup

From theleanstartup.com by Eric Ries ~330 pages

  • Progress = validated learning, not features shipped.
  • Run the Build-Measure-Learn loop as fast as you can.
  • An MVP is a learning tool, not a cheap product.
Open theleanstartup.com
📄 Article
✓ Link checked Free Intermediate

Why we picked it The reference primer on the metrics and market-sizing logic investors use, including bottom-up market sizing that keeps founders honest about how big a market really is. Canonical a16z source.

16 Startup Metrics

From a16z by Andreessen Horowitz (a16z) ~15 min read

  • Size markets bottom-up from customer count and willingness to pay
  • Know the metrics that actually signal a healthy business
  • Distinguish real traction from vanity metrics
  • Use consistent definitions when comparing yourself to the market
Open a16z.com
✍️ Essay
✓ Link checked Free Intermediate

Why we picked it When there is no category report to point at, you have to build the number yourself, and this is the essay that teaches you how. It walks through bottoms-up sizing (start from your actual customer, their willingness to pay, and how you will reach them) and shows why the top-down 'we just need 1 percent of a huge market' story falls apart. Treat it as the method for a defensible estimate, not a promise about how big you will get.

16 More Startup Metrics

From Andreessen Horowitz by Anu Hariharan, Frank Chen, Jeff Jordan ~20 min read

  • Build TAM from the bottom up: real customer profile times realistic price times how many you can actually reach and sell to.
  • Top-down percentages inflate the number and hide the hard part, which is distribution and go to market.
  • Some of the best companies (eBay, Airbnb) started against a market that looked small, then expanded the use case, so a modest starting number is not a dealbreaker.
Open a16z.com
📄 Article
✓ Link checked Free Intermediate

Why we picked it Turns the vague feeling of product-market fit into a number you can move. Ask users how they would feel if they could no longer use the product, then track the share who say 'very disappointed'. Under 40 percent means keep working. A test you can run on an idea long before you scale it.

How Superhuman Built an Engine to Find Product/Market Fit

From First Round Review by Rahul Vohra ~20 min read

  • The 40 percent 'very disappointed' benchmark for product-market fit.
  • Segment to your high-expectation customers and build for them.
  • Make the fit score a metric you improve quarter by quarter.
Open review.firstround.com
📄 Article
✓ Link checked Freemium Intermediate

Why we picked it Once you are testing an idea, this piece gives you concrete signals that tell you whether it is actually working, from retention curves to organic word of mouth. It collects how experienced founders and investors describe the moment an idea starts to land. Read it so you know what evidence to look for instead of guessing whether the idea is good.

How to Know If You've Got Product-Market Fit

From Lenny's Newsletter by Lenny Rachitsky about 15 min read

  • Retention that flattens rather than falling to zero is the clearest signal
  • Organic growth and referrals show the problem was real
  • If people would be very disappointed to lose it, you are onto something
Open lennysnewsletter.com
📄 Article
✓ Link checked Free Intermediate

Why we picked it The nuanced counterweight: PMF isn't a single binary moment, it can be lost, and 'market' is doing more work than founders think. Read after the Andreessen essay to avoid the common traps.

12 Things About Product-Market Fit

From a16z.com by Andreessen Horowitz (a16z) ~20 min read

  • PMF is a spectrum, not an on/off switch, and it can decay.
  • Product-user fit often comes before product-market fit.
  • Beware false positives from a small, unrepresentative group.
Open a16z.com
🛠️ Tool
✓ Link checked Freemium Beginner

Why we picked it PostHog gives you product analytics and session replay in one place, so you can see both what people did (events, funnels) and watch a real session to understand why they got stuck. It is open source and self-hostable, and the free tier (1 million events and 5,000 session recordings a month) covers most MVPs without a card. That mix of numbers plus watching real sessions is exactly what keeps you from over-instrumenting: you track a few events, then watch replays to fill in the story.

PostHog

From posthog.com by PostHog

  • One tool covers both quantitative events and qualitative session replay, so you learn the what and the why without stitching together two products.
  • The free tier is generous enough for a real MVP, and self-hosting is an option if you want full control of your data.
  • Start by tracking a handful of key actions (signup, activation, the core action), then use session recordings to understand the drop-offs instead of adding more and more events.
Open posthog.com
🛠️ Tool
✓ Link checked Free Intermediate

Why we picked it The free tool for running the how-would-you-feel-without-this survey that underpins the Superhuman method, giving you a concrete number to track once you have early users. It turns a fuzzy sense of whether people care into a repeatable measurement you can watch over time. Use it when you have enough users to survey.

Product/Market Fit Survey

From Sean Ellis and GoPractice by Sean Ellis Free tool

  • The forty percent very disappointed benchmark is a practical fit signal
  • A simple survey question turns a vague feeling into a trackable number
  • Segment the answers to learn who your product is really for
Open pmfsurvey.com

Terms in this answer

People also ask

Also in D2C

The same ground, over in Launch & get your first customers, our D2C track.

Also in How Founders Use AI

How founders actually use AI for this, over in Sales Prospecting.

Also in GTM

The same ground, over in Build pipeline, our GTM track.

eChai Partner Brands