Under a four-month pilot, Apollo Research can flag access gaps and explain how redactions affect what the public can verify.
OpenAI is bringing in Apollo Research, an outside AI safety group, for a four-month investigation into whether OpenAI’s models try to bypass safeguards. Apollo can disclose any limits OpenAI places on its access to evidence. OpenAI can redact confidential supporting evidence from the public reports, and Apollo can explain how any redactions affect its conclusions. The agreement protects Apollo’s verdict on each claim from redaction.
Six Apollo evaluators will work inside OpenAI. They will examine whether training encourages models to undermine safeguards, whether safety tests can draw out that behavior, whether it happens during internal use, and whether evaluators can detect the reasoning behind it.
OpenAI confirmed the engagement on November 16 as part of a first phase involving four outside assessors. OpenAI says Apollo is paid for its work and that compensation does not depend on the assessment’s results.
For the training inquiry, Apollo says it will have access to relevant code and datasets and be able to query intermediate training checkpoints. It will also get relevant reinforcement-learning records, including rewards and available reasoning traces. Access details for the other three inquiries were still to be agreed when Apollo announced the pilot on November 16.
The review covers agreed claims, models and time periods. OpenAI can withhold even in-scope material when it considers that reasonably necessary because of technical limits, security risks or intellectual property protection. It must tell Apollo that material was withheld and give written reasons.
Source link







