Krutrim Si Designs, the brainchild of Ola's CEO Bhavish Aggarwal, is set to unveil its highly anticipated generative artificial intelligence (AI) chatbot app. [...] The chatbot claims proficiency in all 22 scheduled languages of India and boasts a unique set of features. However, a recent interaction with the AI has raised eyebrows, leading to a debate about the accuracy of its responses.
Curated from analyticsvidhya.com →
Krutrim opened to a public beta in February 2024 as India's own foundation model, built for Indian languages. Users immediately found the assistant getting Indian facts wrong and, at one point, answering that it had been created by OpenAI. The company's explanation was that an open-source dataset used in fine-tuning had carried that answer in and that the dataset was removed, and its own blog acknowledged hallucinations and a short context window in the beta. Aggarwal said the error rate on Indian contexts would still be lower than the global models. It is on this page as the case closest to home for anyone in this network shipping a model: the specific failure was not the model's reasoning, it was what came in with somebody else's training data.
