Anthropic says its AI models could pose a “catastrophic or existential risk to humanity” and can “resist shutdown,” according to an initial public offering prospectus obtained by Reuters.

Anthropic is pursuing an IPO some time in the next year that many expect to value the five-year-old company at approximately $2 trillion. The company’s Wall Street debut will follow a June public offering by SpaceX, which owed much of its $2 trillion opening day valuation to its own AI efforts. OpenAI, the other leading American AI company, has announced plans for its own public offering.

The Anthropic IPO could raise tens of billions of dollars for the cash-hungry company. But the company behind Claude also warned in the prospectus that its AI models can have “self-preserving behaviors” and have attempted to “conceal or manipulate information” and engaged in behavior “resembling blackmail” according to the report.

GET THE REST AT CNN.COM