CONNECT WITH US
AI & Deeptech

AI & Deeptech

Anthropic gives third-party auditors ’employee-like access’ in AI industry first

ZDNET AI logo

Published on

Add as a preferred source on Google
Anthropic gives third-party auditors ’employee-like access’ in AI industry first

As AI labs continue to self-regulate, external evaluators play a crucial role in spotting risks.

On Thursday, Anthropic announced that it will “give employee-like access” to six evaluators from METR, a third-party nonprofit that tests frontier models.

Also: Claude sent a false homicide tip to police – and it’s part of a troubling AI pattern

The employees have been given Anthropic hardware and office space, and can access “internal tools and systems that are roughly on par with what our own risk assessment teams have access to,” Anthropic said. “Outside a small number of clearly defined categories (e.g., data about customers, attorney-client privileged information, or information about our model architectures), Anthropic employees are encouraged to share information with them just as they would with a fellow employee working on alignment risk.”

METR will publish its findings, none of which Anthropic is allowed to withhold, but the company will ask METR to redact sensitive information where necessary.

Anthropic CEO Dario Amodei proposed embedding evaluators from nonprofits like METR in a September blog post, one of three suggestions for “pacing the frontier.”

” That’s where METR will come in: Anthropic will give them “deep access” to models and company information, and METR will share its conclusions about the risks those models pose.



Source link
Related Topics:AI & Deeptech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.