EV charging firm Xeal plans to use its existing U.S. network to deploy the “world’s first edge inference compute network using idle EV charging capacity.” The big idea is that it already has 1,600+ locations and 200MW of permitted, installed electrical infrastructure, so it aims to “deploy over 100,000 NVIDIA GPUs” at these sites. Thus it has developed Latient Pods (pictured), with each containing up to 48 Nvidia Hopper or Blackwell Ultra GPUs. We hope charging location security will be adequate to keep thieves away from these cabinets, as they are probably worth $2M+ each.
Nikhil Bharadwaj, co-founder and CEO of Xeal, explained that Latient Pods can deliver inference compute today while new data centers are still being built. “Latient is the fastest way to bring new compute online, tapping already permitted and grid-connected, yet idle energy capacity, located right where it's needed for ultra-low latency, with no water hookup requirements,” highlighted the exec. Grid interconnect is said to be one of the trickiest things for those looking to bring new compute online, but Xeal’s EV charging sites, which “typically operate at less than 10% of permitted capacity,” can deliver processing power via a distributed network across a metropolitan area.
An Nvidia rep also praised the upcoming Latient Pod network for being an innovative way to bring low-latency inference closer to users while making better use of infrastructure that has already been built.
In the rendered image from Xeal, a Latient Pod looks quite a lot like a broadband fiber cabinet that you might have on your street.
Source link







