CONNECT WITH US
Tech

Tech

Sarvam’s AI Inference Play, Perplexity’s IPO Soon & More

Inc42 - All News logo

Published on

Add as a preferred source on Google
Sarvam’s AI Inference Play, Perplexity’s IPO Soon & More

Sarvam’s Token Factory is finally live. The new offering will let enterprises access Indian and global AI models through a single API while running workloads on GPUs in India. With the unicorn making a bold play for the local AI inference market, can it outpace global giants?

Unified Models Access: Token Factory hosts Sarvam’s own 105B model alongside overseas open-weight models from Google, DeepSeek, GLM and Kimi. Developers can switch between models without setting up their own compute. Leaning on three-tier caching architecture, Sarvam is claiming latency and throughput speeds that rival global inference leaders.

The Sovereign Pitch: Beyond raw speed and cost, Token Factory’s central pitch rests on sovereign infrastructure. Because every model runs directly on Sarvam’s India-based GPU clusters, the AI unicorn aims to woo enterprises that have to satisfy strict data residency mandates. For the BFSI customers, the company is also offering dedicated GPU capacity and on-premises inference deployments.

A Crowded Arena: However, Sarvam is not alone in offering local inference. Krutrim has been hosting DeepSeek models on Indian servers since last year, while OpenAI recently introduced India-based API inference for GPT-6 Luna workloads. Anthropic also offers in-country inference for select Claude models through Amazon Bedrock. As such, the jury is still out on whether Sarvam’s local inference playbook is coming too little and too late. 

Questions Linger: Critics have also flagged that Token Factory hosts overseas models despite Sarvam positioning itself as a champion of sovereign Indian AI. While Sarvam says hosting global models locally supports data residency, questions remain over whether reliance on foreign open-weight models dilutes its push for homegrown AI capability.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.