Nvidia wants new AI capacity to show up at the data center fully built. At its GTC Berlin conference on Wednesday, the company introduced DSX POD, a reference design for shipping containers that partners fill with Vera Rubin racks, networking, and liquid cooling before they leave the factory.

Installing and wiring up racks in a conventional data center can take months, Nvidia says. But a DSX POD can be ready to deliver tokens in as few as 14 days, as long as the site already has the necessary power, cooling, and network connections (which are, to be fair, often bottlenecks, too).

The idea here is for data center operators to get to value faster, because, as Nvidia founder and CEO Jensen Huang said in a statement, “An AI factory creates value when it starts producing tokens — not when construction is complete.”

Each container holds seven Vera Rubin NVL72 racks, or 504 Rubin GPUs. Ian Buck, Nvidia’s vice president of hyperscale and high-performance computing, said in a press briefing ahead of the announcement that a single unit packs about 10 million components and weighs around 28 metric tons.

The containers also come with roughly 20 kilometers of copper cabling and 17 kilometers of scale-out networking preinstalled and tested. Once a container arrives, crews set it in place, connect it to its neighbors, and run the final burn-in tests, Buck said.

Buck also noted that Nvidia designed the system to use no water for cooling. Vera Rubin can run on coolant as warm as 45 degrees Celsius, Nvidia says, so dry coolers, which work pretty much like a car’s radiator, can do the work instead of the evaporative cooling towers that are still the standard for many data centers today .

Source link