Business News Tech AI Anthropic flags risk of AI systems slipping beyond human control in IPO filing
Anthropic flags risk of AI systems slipping beyond human control in IPO filing
In its IPO (initial public offering) filing made public on Monday, the company said that advanced AI systems could become dangerous if they are developed without proper “safeguards, oversight and security measures.” Such systems could be misused or turned into weapons, the company said.
Claude-maker Anthropic has warned that increasingly powerful artificial intelligence (AI) systems could pose catastrophic risks to the entire human race. The warning comes at a time when Anthropic is preparing for what could become one of the biggest stock market listings in history. In its IPO (initial public offering) filing made public on Monday, the company said that advanced AI systems could become dangerous if they are developed without proper “safeguards, oversight and security measures.” Such systems could be misused or turned into weapons, the company said. “Concerns have been raised both within our organisation and by other researchers, regulators, policymakers, and industry participants that sufficiently advanced AI systems could, if not developed, deployed, and operated with appropriate safeguards, oversight, and security measures, pose catastrophic or existential risks to humanity, particularly if such systems were misused, replicated, weaponised, or allowed to operate with a high degree of autonomy,” Anthropic said.
AI could accelerate its own development Anthropic also said that its AI models are already helping speed up its own research, and warned that the risks could grow if AI systems begin doing a much larger share of the work involved in developing newer AI models.
Source link







