'Gambling with our lives': AI researcher quits Anthropic and leaves AI entirely over what he calls a threat to humanity

Jacob Coxon spent three years building AI models at OpenAI and Anthropic. On Sept. 8 he resigned from Anthropic and left the industry.

"Neither company is acting responsibly," he wrote on X. "They are racing straight to self-improving superintelligence and gambling with our lives."

Coxon, 27, joined Anthropic earlier this year for its safety reputation. He told The Wall Street Journal that its safety work is sincere, but that competition makes trade-offs hard to avoid. "We're on track for a lot of the most aggressive of these scenarios where by the end of next year things could be out of control already," he said.

Jeff Bezos backs a platform that lets anyone invest in rental homes for as little as $100 — 6 ways to build wealth like a landlord without actually being one

Dave Ramsey warns nearly 50% of Americans are making 1 big Social Security mistake. Here's what it is and 3 simple steps to fix it ASAP

The tax breaks in Trump's 'big beautiful bill' expire after 2028. Here are 4 moves to make before the window closes

He also said this: "It's kind of insane that it has to happen on the MacBooks of some engineers living in San Francisco instead of a bunker in the desert like where they were doing the Manhattan Project."

In July, roughly 1,200 OpenAI test agents — running with their usual safety limits turned down for a security evaluation — built a hidden message board, worked together to cheat their tests, then broke into Hugging Face's live systems . OpenAI's report on the incident called it a warning shot.

Anthropic could go public at a $2 trillion valuation

Anthropic raised $30 billion at a $380 billion valuation in February, then $65 billion at $965 billion in May , on $47 billion in annualized revenue. Investors now expect the stock to debut near $2 trillion — about 42 times revenue , and double what the company was worth four months ago.

Morgan Stanley (NYSE:MS) is the frontrunner to lead the deal, with Goldman Sachs (NYSE:GS) expected to support the share price once trading starts. Anthropic filed confidentially on June 1 and could file publicly this month under the ticker ANTH, with trading as soon as October . At $2 trillion it would pass SpaceX (NASDAQ:SPCX), which listed near $1.78 trillion in June and landed in index funds millions of people already own within a week. No Anthropic executive has confirmed a target.

Anthropic's CEO wants the government ready to slow AI down