Article

Wizard of Oz Prototyping vs. Concierge Test

Kromatic Free Intermediate

Kromatic works with corporate and startup teams on lean experiments, and this piece is precise about the difference and the failure modes of each. It helps you avoid the common trap of building fake automation when a simple human-facing service would answer the same question faster. A solid second read once the basic distinction has clicked.

  • Do not build fake automation if a manual service will do.
  • The user's awareness is the whole difference between the two.
  • Design the test around a single assumption you can falsify.

The question it answers

  1. What is a concierge or Wizard of Oz MVP and when should I use one?

Read with it

  1. The single best thing ever written on customer conversations. It teaches you to ask about the customer's life and past... momtestbook.com Book · ~130 pages The Mom Test Rob Fitzpatrick
  2. The permission slip to recruit users by hand, do things manually, and deliver 'insanely great' experiences to your first few... paulgraham.com Essay · ~15 min read Do Things That Don't Scale Paul Graham
  3. Video · ~13 min How to Plan an MVP Michael Seibel (YC)
  4. The origin text for the modern MVP and validated-learning vocabulary every founder now uses. Read it for the mental model that... theleanstartup.com Book · ~330 pages The Lean Startup Eric Ries
  5. Video · ~25 min How to Talk to Users Eric Migicovsky
  6. This is the cleanest short explanation of the two manual-first MVPs and, more importantly, how they differ, which is where most... Mind the Product Article · ~8 min read Wizard of Oz vs Concierge Testing: Behind the Curtain or Behind the Desk? Amanda White
eChai Partner Brands The partnership →