From IIT Bombay to Building India's AI Future: Meet Pratyush Kumar, Co-Founder of Sarvam AI

India requires robust AI defense capabilities as advanced AI systems become accessible to potential rogue actors, according to Sarvam co-founder Pratyush Kumar. Speaking at a media event, Kumar stated that AI can now be considered a weapon system, used by rogue players posing a significant threat. He stressed the need for India to develop its own AI defensive mechanisms while continuing to expand AI use.

Kumar emphasized the importance of building a 'defence layer' and accelerating AI capabilities in India. However, he underscored that national security considerations and cybersecurity must receive greater attention. He cautioned that the rapid evolution of AI systems presents management challenges, with technological complexities arising from models interacting with each other.

The Indian government is currently developing an AI safety and governance framework, including an AI Governance Group, Technology and Policy Expert Committee, and AI Safety Institute, as part of the IndiaAI Mission. Sarvam was chosen under this mission to create a domestic large language model ecosystem. The company has identified cybersecurity as a key area for further AI model development.

Kumar's remarks highlight the need to balance the acceleration of India's AI capabilities with the construction of safeguards against emerging cybersecurity and national security risks.