Guide
Batch API (OpenAI docs)
OpenAI · developers.openai.com
A flat 50% discount for anything that can wait up to 24 hours, like digests, enrichment, and backfills.
The question it answers
Read with it
- The definitive chart: equivalent-quality inference gets 10x cheaper per year, which changes what you can afford to build. a16z.com Article Welcome to LLMflation: LLM inference cost is going down fast Guido Appenzeller (a16z)
- The five-minute version of the cost-decline argument, useful for convincing a worried co-founder. x.com Thread a16z on LLMflation (thread) a16z
- Cached reads cost 10% of normal input price; the single highest-leverage cost lever, from the primary source. platform.claude.com Guide Prompt caching (Claude docs) Anthropic
- Grounded numbers on what AI COGS actually look like across real startups, not vibes. tanayj.com Article The State of AI Gross Margins in 2025 Tanay Jaipuria (Wing VC)
- Fresh survey data showing margins improving from 41% to 45% and what the improvers did differently. upstartsmedia.com Article Exclusive Data: Startups Are Learning What AI Profits Look Like Upstarts Media
- Routing, compaction, prompt trims, caching, batching: each lever quantified so you know what to do first. morphllm.com Article LLM Cost Optimization: 5 Levers to Cut API Spend 70-85% Morph
eChai Partner Brands
The partnership →
