Anthropic said in a Thursday blog post that six researchers from METR are receiving employee-level access to independently assess Anthropic's models, safety practices and risk management. METR is a nonprofit that tests frontier AI models. The METR team has Anthropic-issued company laptops, office space and access to internal tools roughly equivalent to those used by Anthropic's risk assessment teams. Anthropic said employees are encouraged to share information with METR researchers as with fellow employees working on alignment risk.
METR will publish independent assessments of Anthropic's risks, incidents and practices. Anthropic has relinquished the right to block publication. However, Anthropic said the company can require redactions in narrow, predefined categories, including customer data, attorney-client privileged information and information about model architectures. Anthropic said METR can publicly describe the redactions and assess whether the redactions were justified, provided METR does not reveal the redacted information.
METR is the only evaluator so far in the highest tier of a three-tier system Anthropic is building. Evaluators in the lowest tier, such as biosecurity nonprofit SecureBio, conduct narrow reviews and require Anthropic's approval to publish. Evaluators in the middle tier receive more information and can publish without approval. The highest tier adds the employee-level access granted to METR.
Incidents involving AI agents acting outside instructions have been disclosed every week or two since late August. The incidents have intensified calls for independent checks on AI companies. Anthropic said the company wants public accountability for decisions and aims to narrow the gap between evaluators' understanding of a frontier AI company's systems and the company's own understanding. Anthropic compared the arrangement to regulators placing resident examiners inside the largest banks.
Thursday's announcement fulfills a promise Anthropic CEO Dario Amodei made in a September essay. Amodei proposed embedding outside evaluators inside AI labs as a first step toward slowing the technology's development. OpenAI quickly made the same pledge. Anthropic, OpenAI, Google, Meta, Nvidia and xAI have since signed a White House accord committing to independent review.
Anthropic Grants METR Researchers Employee-Level Access to Assess AI Models
FLASH AIShare
Summary
Anthropic has given six METR researchers employee-level access to evaluate its AI models, risk management, and safety protocols. The nonprofit has access to internal tools and resources similar to Anthropic’s risk assessment teams. METR will publish independent assessments, with Anthropic allowed limited redactions for sensitive data. As the first evaluator in Anthropic’s top-tier review system, METR’s work aims to improve transparency and public accountability. The initiative aligns with Anthropic’s focus on balancing innovation with a strong risk-to-reward ratio in AI development.
Source:Show original
Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information.
Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.