As Anthropic gets set for a stock market listing, what risks is AI creating?
As Anthropic prepares for a stock exchange listing, analysts and the company itself have highlighted the technology ’s benefits – but also possible catastrophic dangers. In documents released before the US initial public offering, Anthropic said AI could spur economic growth and lead to rapid medical advances, while creating risks of new biological weapons being developed or ofhuge cybersecurity…
Anthropic, an artificial intelligence company preparing for a stock market listing, is drawing attention to both the advantages and potential catastrophic dangers posed by AI technology. In its US IPO documents, Anthropic stated that AI could drive economic growth and accelerate medical advancements, but also cautioned about the risks of developing biological weapons or causing massive cybersecurity disruptions.
Technology commentator Adnan Bashir pointed out that current containment and mitigation measures are "fragile and underdeveloped," warning that failure to address these issues could lead to catastrophic risks for the financial system, infrastructure, and economies. Anthropic itself has acknowledged the potential for misuse, stating that powerful AI systems can be used for both good and ill.
The company noted that autonomous AI systems may pose a "global security threat of the first order." These warnings came shortly after a researcher at Anthropic, Evan Hubinger, suggested there was a more than one-in-ten chance that AI could destroy humanity over the next decade. While some experts, like Western University's chief AI officer Prof Mark Daley, believe that AI has the potential to annihilate humanity, they agree that there are real risks.
One of the primary concerns is the connectivity of all physical infrastructure to the internet, which creates an extensive attack surface. Recent incidents, such as supermarket freezers being hacked in France, highlight the potential dangers of AI misuse. Some argue that governments may not implement adequate regulations to address these risks, fearing that doing so would stifle the economic benefits AI can bring.
Prof Ashley Braganza expressed skepticism about the adequacy of existing regulations, particularly regarding AI models that have not yet been released or those being developed by AI itself. The rapid integration of AI into the workforce has also led to concerns about job displacement. According to a recent Marsh report, nearly 85% of workers in the UAE used AI to assist with their work, but 44% were hesitant to use new technology due to fears that it would take over or alter their roles.
Regulatory concerns extend to the potential use of AI in the deployment of autonomous weapons. UAE Minister of State for AI, Digital Economy, and Remote Work Applications Omar Al Olama called for a global consensus on regulating AI's use in military applications. Recent tests of large language models revealed that all but two of 134 leading AI models could provide information useful for launching mass-casualty attacks or building deadly weapons.
Despite these risks, Anthropic's IPO is expected to value the company at $1.5 trillion to $2 trillion, reflecting the growing confidence in AI's potential.
Written by urgent.news from The National Business's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
