Anthropic has given nonprofit METR employee-level access to its systems and is in talks with others including Hugging Face, as AI companies pitch external evaluators as a way to safely advance the technology without slowing its development.

The developer of Claude models is also working with biosecurity nonprofit SecureBio and Accenture's AI business Faculty as evaluators, it said in a blog post on Thursday.

Reuters exclusively reported earlier this week that Anthropic and OpenAI had sought significant control over what outside reviewers could publish, concerned that the findings could leak trade secrets.

A person familiar with the matter told Reuters that talks with Anthropic had evolved recently, with the company becoming more open in negotiations.

A key sticking point between evaluators and AI labs is that information the companies might consider crucial intellectual property can also be relevant to assessing a model's risks, leading to disputes and redactions, a separate person familiar with the discussions told Reuters.

Experts have also said the independence of evaluators is a concern, as Anthropic ​and OpenAI choose who gets to carry out the reviews.

The outcome of the talks ⁠will help determine how the world scrutinizes a technology that some of its creators warn may be advancing beyond humanity's ability to manage.

Anthropic said on Thursday six employees of METR — or Model Evaluation and Threat Research — have company hardware, office space and access to internal systems roughly equivalent to its risk assessment teams. However, customer data, legally privileged information and model architecture will remain off limits.

Source link