Article · 10 minute read

Vanity Metrics vs. Actionable Metrics

Eric Ries · The Blog of Tim Ferriss Free Beginner

This is the piece that named the problem you are asking about: the difference between numbers that make you feel good and numbers you can actually act on. Eric Ries (the Lean Startup guy) wrote it as a guest post, and it is still the clearest short read on why a traffic spike or an upvote count tells you almost nothing. Treat it as a starting point for deciding which one or two numbers your launch should live or die by.

  • A metric is only useful if a change in it tells you what to do next. Total hits and signup counts almost never pass that test.
  • Cohort analysis (following a group of users through registration, trial, and purchase over time) shows whether your launch actually changed behaviour, or just briefly inflated the top of the funnel.
  • Look at per-customer and per-segment numbers, not one big aggregate, because a healthy total can hide the churn and drop-off that decide whether a launch worked.

It answers 3 questions

  1. How do I tell whether my growth is real or just a spike from a launch or a discount?
  2. What early growth mistakes should a first-time non-technical founder avoid when reading their metrics?
  3. How do I actually measure whether a launch worked, beyond the vanity upvotes and traffic spike?

Read with it

  1. The reference primer on the metrics and market-sizing logic investors use, including bottom-up market sizing that keeps... a16z Article · ~15 min read 16 Startup Metrics Andreessen Horowitz (a16z)
  2. The nuanced counterweight: PMF isn't a single binary moment, it can be lost, and 'market' is doing more work than founders... a16z.com Article · ~20 min read 12 Things About Product-Market Fit Andreessen Horowitz (a16z)
  3. The origin text for the modern MVP and validated-learning vocabulary every founder now uses. Read it for the mental model that... theleanstartup.com Book · ~330 pages The Lean Startup Eric Ries
  4. The definitive talk that reframes launching from a one-shot event into a repeatable tactic, exactly this category's thesis. YC... YC Startup Library Video · ~25 min How to Launch (Again and Again) Kat Manalac (Y Combinator)
  5. When there is no category report to point at, you have to build the number yourself, and this is the essay that teaches you... Andreessen Horowitz Essay · ~20 min read 16 More Startup Metrics Anu Hariharan, Frank Chen, Jeff Jordan
  6. PostHog gives you product analytics and session replay in one place, so you can see both what people did (events, funnels) and... posthog.com Tool PostHog PostHog
eChai Partner Brands The partnership →