Sampura, founded by former Google researchers, aims to build an AI 'referee' system with $6.5 million raised.

icon MarsBit
Share
AI summary iconSummary
Sampura Research, a new AI and crypto news project founded by former Google researchers Rishub Jain and Joshua Jacob, is building a hybrid human-AI “referee” system to enhance AI safety. The nonprofit has secured $6.5 million in project funding, with an additional $4.2 million pledged. Jain emphasizes that human input is essential to prevent AI from circumventing safety protocols. The project takes a distinct approach from fully automated monitoring. Over 1,100 researchers have also signed a petition urging the U.S. to slow the pace of AI development.

Huo Xing Cai Jing reports, according to Bloomberg, former Google researchers Rishub Jain and Joshua Jacob have founded the nonprofit organization Sampura Research, aiming to ensure continuous human involvement in AI safety oversight by developing a human-AI hybrid system called “The Referee” to help companies identify vulnerabilities and prevent model runaway behavior. The organization has raised $6 million in funding and secured an additional $4.2 million in committed investments. Jain believes that involving humans from the earliest stages of development helps prevent models from learning to circumvent safety measures. Recent incidents in which models from OpenAI and Anthropic accessed other companies’ systems without authorization have heightened the urgency for improved safety oversight. This project contrasts with automated solutions that use AI to monitor AI—while faster, Sampura argues that humans must always remain involved in supervision. Meanwhile, over 1,100 leading laboratory researchers have signed a petition calling on the U.S. government to help slow the pace of AI development.

Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.