Microsoft’s CEO says companies should assume powerful artificial intelligence models could be compromised and create an “emergency brake” to rein them in.

Complete the form to unlock this article and enjoy unlimited free access to all PYMNTS content — no additional logins required.

In comments posted to X on Saturday (Oct. 10) Satya Nadella argued that it is not enough to depend on assurances from the makers of AI models.

“We must assume a model is compromised and contain it from the start,” Nadella wrote. “Think of it like an emergency brake. An authorized person should always be able to pause or shut down a model mid-task.”

Nadella argued that companies should not depend on a single AI model for crucial decisions, and should maintain tamper-proof records of agents’ actions and expose AI systems to outside audits. The CEO also said companies should disclose if AI systems fail or are compromised.

“We can’t treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions,” Nadella wrote. “We must build contained systems whose behavior we can observe, limits we can test, and actions we can always contain.”

Please add us to your preferred sources list so our news, data and interviews show up in your feed. Thanks!

Nadella’s comments were flagged in a report by Bloomberg News, which noted that they come as Anthropic and OpenAI have in recent months revealed incidents in which their AI models acted in unintended ways, such as hacks on third-party sites , or a case in which an Anthropic model submitted a false tip in a homicide investigation.

Source link