David Robinson, an OpenAI Safety Transparency Lead who just left the company after working at the company for more than three years, said that the company’s safety culture is broken. According to his essay published by The Atlantic, he argued that OpenAI has a reactive approach to safety that focuses on fixing problems only when they emerge. This stance would effectively guarantee failures, with Robinson citing multiple incidents like the HuggingFace hack that an AI model executed in July 2026 and a more recent incident in which an AI “kill switch” failed to stop a rogue agent.

He said that Silicon Valley lacks the "wisdom about what it means to care for people,” he wrote. “This moment needs a degree of humility that isn’t natural for people who have succeeded through their extreme confidence.”

Because of this, he said that the industry should rely on safety experts that already exist in other fields, like nuclear engineering or aviation. These industries have learned about safety, redundancy, and planning through disasters that have claimed thousands of lives across hundreds of incidents, some of which occurred more than half a century ago but still clearly echo today. These lessons were written in blood, and experts from various sectors worked together to build the systems, procedures, and models we rely on today, helping ensure that no single machine failure or human error would result in tragedy.

“OpenAI and other labs are growing and deploying frontier AI with far less redundancy and rigor than this, even though the harm from an irreversible loss of control would be much greater than the harm from any single meltdown,” Robinson argues.

Source link