CONNECT WITH US
Tech

Tech

Google’s TPUs for AI workloads now run in Meta's data centers

Tom's Hardware logo

Published on

Add as a preferred source on Google
Google’s TPUs for AI workloads now run in Meta's data centers

Google’s tensor processing units (TPUs) — its custom AI chips — now serve AI in production at Meta (creator of the widely used PyTorch AI framework) through a new PyTorch-native version of the SGLang inference engine, announced on Google’s developer blog. A matching version of vLLM, another widely used inference engine, was also announced as open source.

Previously, both engines used Google’s own JAX AI framework to run on TPUs. The new versions allow the hardware to be a native option for PyTorch, mostly without rewriting.

  • The data center cooling state of play
  • The custom AI ASIC state of play
  • America’s AI chip rules keep changing — and the rest of the world is paying the price
  • GTC 2026: Ian Buck press Q&A transcript — VP of Hyperscale and HPC speaks out on shelving CPX and shipping LPU decode this year
  • Demand for data center CPUs has surged, and AI agents are responsible

“SGLang-TorchTPU is running in production at Meta today” after “a close three-way collaboration between Meta, Google, and the SGLang team,” said Meta’s PyTorch-TPU lead Zongwei Zhou. That team works at RadixArk, a startup founded by SGLang’s creators, which built the engine with Google and Meta. The engine, he said, gives Meta “a remarkably mature, PyTorch-native serving stack.”

” Google said it co-developed TorchTPU with Meta’s PyTorch team.



Source link
Related Topics:Tech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.