CONNECT WITH US
AI & Deeptech

AI & Deeptech

Anthropic says new safeguards sharply reduce AI distillation attacks

IndiaTimes (ET) - AI logo

Published on

Add as a preferred source on Google
Anthropic says new safeguards sharply reduce AI distillation attacks

Business News Tech AI Anthropic says new safeguards sharply reduce AI distillation attacks

Anthropic said on Monday new measures designed to prevent rivals from copying the capabilities of its Claude AI models have reduced data harvested in so-called distillation attacks

Anthropic said on Monday new measures designed to prevent rivals from copying the capabilities of its Claude AI models have reduced data harvested in so-called distillation attacks by about 90% to 99%. * Model distillation has emerged as a key concern for leading AI companies due to intensifying US-China competition, with firms including Anthropic, OpenAI and Google arguing the practice enables rivals to reproduce advanced capabilities more quickly and at lower cost * Anthropic said safeguards restricting access to Claude's reasoning have sharply reduced extraction attempts, with "the number of reasoning tokens extracted by distillers" now "10 to 100 times lower than it was before"

* The California-headquartered company said it had made it harder to use proxy networks to repeatedly probe Claude's protected reasoning, blocking extraction attempts and hindering large-scale distillation efforts * Anthropic said its safety system is "roughly as robust as those that prevent Claude from helping build bioweapons" and has "a false positive rate of less than 0.1%" * Anthropic banned tens of thousands of accounts linked to distillation campaigns and cited Chinese AI startup Z.ai , also known as Zhipu, as an example of a company that attempted to distill capabilities from Claude while developing its GLM-5.3 model, warning such practices pose safety and national security risks * Z.AI did not immediately respond to a request for comment


Source link
Related Topics:AI & Deeptech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.