Meta and Sarvam AI Collaborate to Develop Vernacular Large Language Models for Indian Languages

In a significant development, global tech giant Meta, formerly known as Facebook, has joined forces with Sarvam AI to develop Large Language Models (LLMs) in vernacular languages. The announcement was made by Meta's head in India, Sandhya Devanathan, during 'The Nudge Forum.' Devanathan emphasized the transformative impact of Sarvam's work in overcoming the limitations imposed by predominantly English LLMs.

Sarvam AI is leveraging Meta's Llama open-source models to construct LLMs, with a focus on vernacular languages. Devanathan disclosed that after the successful deployment of the Hindi LLM, plans are in place for expansion to other languages. While acknowledging that the incubation period might be prolonged, she stressed that the eventual impact would be exponential, significantly influencing diverse communities across India.

LLMs, or Large Language Models, are AI algorithms utilizing deep learning techniques and extensive datasets for understanding, summarizing, generating, and predicting new content. These models are particularly pivotal in fostering linguistic diversity, making digital content more inclusive.

Devanathan highlighted that Meta has been leveraging AI in its operations for an extended period. Still, it's Generative AI that has become a buzzword recently. She mentioned that around one-fourth of the recommendations on Instagram are now generated by AI, showcasing the integration of cutting-edge technology into user experiences.

The use of AI extends beyond user recommendations, as Devanathan explained Meta's commitment to user safety through AI algorithms. Content is proactively removed, ensuring a secure online environment. Additionally, AI has significantly contributed to a notable increase in advertiser returns, reaching approximately 30-35%, demonstrating the broader impact of advanced technologies on business outcomes.

Moreover, Meta's collaboration with the state-promoted Open Network for Digital Commerce (ONDC) was highlighted. The focus of this partnership revolves around enhancing the skills of sellers, particularly small businesses registered on WhatsApp, and facilitating their integration with ONDC. This aligns with Meta's commitment to supporting small businesses and fostering digital commerce ecosystems.

Conclusion:

Meta's collaboration with Sarvam AI underscores the company's commitment to linguistic diversity and inclusivity in the digital space. The development of vernacular LLMs is poised to have a far-reaching impact, empowering users across India with a more personalized and accessible online experience. As technology continues to advance, such collaborations become crucial in bridging language gaps and creating a more connected and inclusive digital landscape.