In a significant development, weeks after Dario Amodei, CEO of Anthropic warned about the risks of developing the technology at a rapid pace, the Anthropic has cautioned investors in its IPO filing and stated that advanced AI could be “catastrophic or pose existential risks to humanity.” Therefore, experts believe Anthropic’s IPO filing has put the spotlight on both the extraordinary potential and risks of advanced artificial intelligence.
The filing outlines scenarios where AI systems could resist shutdown or use sensitive information to influence humans, even as Anthropic targets a valuation of over $2 trillion. Anthropic’s IPO prospectus also reflects potential risks associated with its AI models, including the possibility of “self-preserving behaviours.” The company said these could involve attempts to “resist shutdown, conceal or manipulate information” and behaviour “resembling blackmail.”
Anthropic IPO Filing: AI Could Resist Shutdown, ‘Blackmail’ Humans; $2 Trillion Valuation Target
