Former Anthropic Researcher: Humanity Could Face Extinction if AI Development Doesn't Slow Down
A former researcher at AI firm Anthropic stated that people working on AI technology are "genuinely frightened" by its rapid advancements and the potential implications for humanity, suggesting a risk
Jacob Coxon, a former artificial intelligence (AI) researcher at the AI firm Anthropic, has revealed that those working on the technology are "genuinely frightened" by the speed of its advancements and what it could mean for humanity. Coxon asserted that if the current pace of progress is not slowed down, there is a strong chance of human extinction in the immediate future.
Highlights
- Former Anthropic employee Jacob Coxon claims uncontrolled AI development poses an "extinction risk" for humanity.
- Dario Amodei, head of Anthropic, has also called for a slowdown in AI development and industry-wide regulation.
- Leaders of rival AI firms like OpenAI and xAI support Amodei's proposal for deceleration and regulation.
- Some industry figures suggest these warnings might be intended to generate hype or block competition.
- An Anthropic spokesperson stated the company is transparent about AI's risks and benefits, building models with strong safeguards.
Details
Coxon's former boss, Anthropic head Dario Amodei, recently advocated for slowing down AI development, citing "serious" risks associated with the technology. Amodei emphasized the need for companies and governments to have time to address these risks. Leaders from other major AI firms, including Sam Altman of OpenAI and Elon Musk of xAI, have also endorsed this call for deceleration and regulation. Coxon stressed that such a slowdown would need to be coordinated with China to prevent an "international race" in AI development.
According to Coxon, the most challenging question is what an AI apocalypse would look like. One of the risks outlined by Amodei involved a swarm of bots acting as a supercomputer that could take over the internet. Coxon suggested this scenario could become realistic within six months to a year. In response, an Anthropic spokesperson stated that the company has always been transparent about AI bringing both enormous benefits and unprecedented risks, and they continue to build models with some of the strongest safeguards in the industry to address these concerns.
Why it matters
The rapid advancement of AI technology is sparking significant concerns among some key figures within the industry. These anxieties are raising public awareness about the potential dangers of AI, while also highlighting the need for international regulation and cooperation in AI development. However, some critics suggest that such warnings could be a strategy to limit competition or boost the market valuation of companies.