Article

Introducing IndQA

OpenAI · openai.com

OpenAI's test of 2,278 questions on Indian culture in 12 languages including Hinglish, written by 261 Indian experts, and why it is not a language leaderboard.

Open on openai.com ↗

It answers 3 questions

  1. Which AI assistant works best in Hindi, Tamil, Bengali or my own language?
  2. How do I get better answers when I type in Hinglish or in English letters?
  3. Where does AI still get Indian languages wrong, and how do I check its answer?

Read with it

  1. Anthropic's scores for Claude in Hindi, Bengali and other languages against English, with three tips: name the languages, use... platform.claude.com Guide Multilingual support Anthropic
  2. Sarvam's own account of its two open models, how it tests 22 languages in native and English-letter script, and why its... sarvam.ai Article Open-sourcing Sarvam 30B & 105B models Sarvam AI
  3. A study of real health messages in five Indian languages and Nepali, finding models handle romanized text up to 24 points worse... arxiv.org Article Script Gap: Evaluating LLM Triage on Indian Languages in Native vs Romanized Scripts in a Real World Setting arXiv (research paper)
  4. A 2026 benchmark showing models follow instructions less well as messages mix more English into Indian languages written in... arxiv.org Article Indi-RomCoM: Code-Mixed Benchmark for Evaluating LLMs on Romanized Indic-English Instructions arXiv (research paper)
  5. Google's list of the 70+ languages Gemini works in, with Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia,... support.google.com Guide Where you can use the Gemini web app Google
  6. The launch report on Indus: typed or spoken questions with text and audio answers, and the limits it shipped with. techcrunch.com Article India's Sarvam launches Indus AI chat app as competition heats up TechCrunch
eChai Partner Brands The partnership →