Article · 8 min read

How to Calculate the Inference Efficiency Ratio

Ben Murray · The SaaS CFO Free Advanced

One metric you can start tracking this month: AI product revenue divided by inference cost. It moves before your gross margin does, which makes it the early warning you want rather than the postmortem you get from the P&L.

  • Inference efficiency ratio is AI product revenue divided by inference cost for the same period.
  • For AI infused SaaS, 8:1 is the floor and 10:1 or better is healthy, below 5:1 is a warning.
  • For AI native products the healthy zone is 5:1 or better, since inference is structurally about 20 percent of revenue.
  • Unlike gross margin, which lags, IER is a leading signal: model routing, prompt caching and tiered pricing moved one example from 4.4:1 to 8.0:1 at the same revenue.

The question it answers

  1. My AI features cost real money every time someone uses them. How do I stop gross margin from collapsing?

Read with it

  1. The margin defence most companies are actually reaching for. Poyar's number is the one to remember: roughly 70 to 80 percent of... Growth Unhinged Newsletter · 14 min read Why everyone's switching to AI credits Kyle Poyar
  2. Gives you the current benchmarks to set expectations with your board (roughly 45 to 53 percent depending on how much of the... Jeff Brokaw Article · 12 min read AI Gross Margins: Why the 90% SaaS Benchmark Is Gone Jeff Brokaw
  3. Names the version of this problem that is specific to Indian companies: revenue in rupees, inference billed in dollars, and a... Inc42 Article · 8 min read India's AI Inference Problem Team Inc42
  4. Kiran Darisi (Atomicwork) and Sreedhar Peddineni (GTMBuddy), both out of the Freshworks lineage, on why per seat pricing stops... The Neon Show Podcast · 80 min listen If Big AI Goes Everywhere, What's Left for B2B SaaS? 25 Years, 4 Startups, 3 Eras of SaaS Siddhartha Ahluwalia
  5. Podcast · 72 min Pricing your AI product: Lessons from 400+ companies and 50 unicorns | Madhavan Ramanujam Madhavan Ramanujam, with Lenny Rachitsky
eChai Partner Brands The partnership →