Former Anthropic researcher Jacob Coxon warns of the dangers posed by self-improving AI systems, citing irresponsible competition among tech companies.
| PULSE POINTS |
❓ WHAT HAPPENED: Jacob Coxon, a 27-year-old researcher who recently resigned from Anthropic, has issued a stark warning about the dangers posed by rapidly advancing artificial intelligence. Coxon, who previously worked at OpenAI and spent the past three years conducting AI pretraining research, said both companies are racing toward self-improving superintelligence without adequately addressing the potential consequences. 📺 DETAIL: In a seven-part post on X, which attracted nearly 76 million views overnight, Coxon warned that future AI systems could become capable of hacking systems, transforming industries, and accumulating significant power and resources. He claimed that many AI executives and researchers privately fear that the technology could become capable of causing catastrophic harm before the end of the decade, despite more measured public statements. In an interview with the Wall Street Journal, Coxon said some of the most extreme scenarios could emerge as soon as next year, arguing that competition between U.S. companies and Chinese rivals could encourage labs to accept greater safety risks. Coxon said Anthropic researchers understand the stakes but believe they must continue developing increasingly powerful systems because competitors may not act responsibly, while many at OpenAI have not fully absorbed what he described as the civilizational consequences. His warnings come as other AI leaders, including OpenAI CEO Sam Altman, have also raised concerns about potential security threats from increasingly capable systems. Coxon ultimately said he remains optimistic that AI companies could coordinate on safety measures and urged researchers to reconsider whether they should proceed with major advances without a rigorous understanding of how increasingly powerful models operate. 💬 KEY QUOTE: “The people building AI earnestly believe that it could kill us all by the end of the decade… No other human activity poses this level of danger.” – Jacob Coxon 🎯 IMPACT: Coxon’s resignation underscores growing concerns within the AI industry that the race to develop increasingly powerful systems could be moving faster than safety measures and government oversight can keep pace. If his warnings prove accurate, the consequences could extend far beyond the technology sector, potentially creating major cybersecurity, economic, and national security risks. |
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
— Jacob Coxon (@hilbertspaess) September 9, 2026
Join Pulse+ to comment below, and receive exclusive e-mail analyses.
.jpg){kind=link}
