Anthropic Researcher Resigns, Warns of AI Threats

Jacob Coxon, an artificial intelligence researcher, announced his resignation from Anthropic on X, expressing concerns over the rapid development of advanced AI and its potential to threaten humanity. He stated that both Anthropic and OpenAI are racing towards self-improving superintelligence without sufficient safeguards, labeling this a gamble with human lives.

Coxon emphasized the capabilities of advanced AI systems, warning they could soon surpass human abilities and acquire significant power and resources. He claimed that many in the AI field privately acknowledge the catastrophic risks, asserting that the possibility of AI causing human extinction could exceed 10% within the next decade.

Evan Hubinger, another researcher at Anthropic, corroborated Coxon's concerns, stating that while Anthropic is making efforts, there is no clear plan to address the alignment issues with superintelligence. Coxon's resignation comes amid ongoing debates about managing the risks associated with advanced AI technologies.