OpenAI CEO Sam Altman is really gunning for villain-of-the-year status with PC gamers in particular, but owners of pretty much any computing device everywhere.

Altman appeared on Stripe cofounder John Collison’s Cheeky Pint podcast this week, sipping beers and weighing in on the state of AI. Gizmodo covered and analyzed the bulk of Altman’s remarks here, though another moment from the podcast is worthy of a shout-out. Altman thinks it’s “quite terrible” that individual device owners and/or operators of local AIs have access to DRAM, which is already catastrophically expensive due to massive demand from AI data centers like OpenAI’s (and may be nowhere close to peaking).

You see, it’s inefficient not to just let OpenAI handle it. “A lot of people want local inference. And somehow, they assume that the problem is solved now because we are going to have open-source models, we’re going to be able to run them on our computers, and so we’re not going to need all the stuff in the data center,” Altman said.

“But from a global allocation perspective, actually, it’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used 5% of the time,” he added. “You want maximum utilization in the cloud if you’re trying to deal with this very supply-constrained environment. And somehow many people’s intuition is the opposite of that.”

There is an unobjectionable point buried somewhere in there. Perhaps a future utopian society could provide universal access to centralized compute.

Source link