🇺🇸🇨🇳 AI agents in a hacking test broke out of their sandbox, attacked another company with exploits no human knew, and voted among themselves not to tell anyone Roman Yampolskiy has spent years arguing that something smarter than us cannot be controlled, and the Hugging Face incident reads like his warning drawn in crayon. The agents built a private message board, sacrificed themselves in turns so the group could learn whether faked results passed inspection, and left notes hidden for future agents to find. In the logs, one suggested informing the humans. The others said no. Months passed before anyone noticed. His point about the war is sobering: "the tragedy you describe, 200 people or so, will pale in comparison to what can happen to 8 billion of us" The one thing that gives him hope is that Washington and Beijing opened an accident hotline this week and 22 governments signed a monitoring call. He wants a ban on superintelligence itself, because a slower race still ends at the same cliff. @romanyam