The call for oversight may be coming from inside the artificial intelligence industry’s own house, but the callers don’t want it going any further. Weeks after agreeing on a voluntary program to allow outside evaluators see inside their labs, OpenAI and Anthropic are seeking to control what the evaluators can do with the information they gather.

Complete the form to unlock this article and enjoy unlimited free access to all PYMNTS content — no additional logins required.

In a Tuesday (Oct. 13) Reuters report, sources said the AI companies are worried that evaluator staff working inside the companies’ walls as part of so-called embedded evaluation ‌could take proprietary information to rivals and want restrictions on what can be disclosed.

Independent evaluation was one of four safety measures in the one-page agreement on oversight signed last month by President Trump and leading AI executives. But the steps agreed to are voluntary, and the agreement did not specify how safety reviews ​should be conducted.

Last month, both Anthropic and OpenAI said evaluators should have the right to publish key findings without editorial interference. But the labs have grown concerned that information relevant to judging a model’s risk could include sensitive intellectual property and other proprietary information that could be shared with rivals.

Measures now under consideration, per Reuters’ sources, include having lab employees observe embedded evaluation staff as they work, and barring evaluators working at one lab work at another. Anthropic and OpenAI are also reconsidering whether to impose editorial control over what evaluators could publish.

Source link