Anthropic researcher resigns, warns AI could lose control by end of 2027

iconKuCoinFlash
Share
AI summary iconSummary
Jacob Coxon, an AI researcher from Anthropic, has resigned and plans to leave the AI industry. He previously worked at OpenAI and Anthropic, criticizing their rush to develop AGI without adequate safety measures. Coxon warns that AI could spiral out of control by 2027, emphasizing that current industry trends in AI development are moving too quickly. He argues that key decisions must involve more than just engineers. This development adds to ongoing discussions at the intersection of AI and crypto regarding the future of AI governance.
ME AI News, Beating AI Brief: Anthropic researcher Jacob Coxon has announced his resignation and plans to leave the AI industry. Over the past three years, he conducted pre-training research at both OpenAI and Anthropic. He stated that neither company has been responsibly advancing AI, instead racing to build superintelligences capable of further enhancing their own capabilities—“betting our lives on it.” He moved from OpenAI to Anthropic this year precisely because the latter appeared more committed to model safety. Coxon acknowledges that Anthropic’s safety efforts are genuine, but argues that as long as companies continue competing to be the first to achieve AGI (artificial general intelligence capable of outperforming humans across a wide range of tasks), safety compromises will remain unavoidable—and no single company’s self-regulation can solve this problem. His assessment of the two companies: Many at OpenAI still do not fully grasp the magnitude of the risk; Anthropic understands the risk but believes others cannot be trusted, so it must be the first to succeed. Coxon noted that some AI professionals are privately far more pessimistic than their public statements suggest, with some fearing AI could lead to human extinction before the end of this decade. He personally judges that, under the most aggressive scenarios, AI could become uncontrollable by this time next year—and such decisions should not be made solely by engineers within a few companies. (Source: BlockBeats)
Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.