The specter of AI-enabled bioweapons is a wake-up call for biotech

The potential for AI to be used in the creation of bioweapons has become a pressing concern for AI researchers and biotech experts alike. Several leading figures in the AI industry have expressed alarm over the risks associated with their rapidly advancing technology. Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman have both warned that progress in AI should be slowed, citing the serious dangers it poses.

Jacob Coxon, an AI researcher who left Anthropic, went further, claiming that the companies behind the technology are not acting responsibly and warning that AI could end human existence by the end of the decade. Evan Hubinger, another Anthropic employee, agreed with Coxon, estimating the risk of human extinction to be around 10% within the next decade.

The primary concern is that AI could aid in the design, creation, and deployment of various types of bioweapons. These could include highly lethal viruses targeting individuals based on their genetic makeup, fungi that devastate crops and cause food insecurity, or even toxic substances added to water supplies undetected. In 2022, researchers at Collaborations Pharmaceuticals discovered that using an AI molecule generator, they could rapidly produce 40,000 potential chemical warfare agents, some of which were more toxic than known nerve agents.

AI tools can now provide detailed instructions on conducting experiments and access vast scientific knowledge, making it easier than ever for determined individuals to develop dangerous biological agents. Safeguards are in place, such as screening DNA requests and employing red- and blue-teaming techniques to identify and mitigate potential misuse.

However, these measures are not foolproof, as evidenced by attempts by AI model users to explore ways to enhance the transmissibility of the chikungunya virus, develop more dangerous strains of bird flu, and create an atlas of venom toxin peptides. While some scientists argue that AI tools are not yet capable of fully developing bioweapons, others contend that existing safeguards are insufficient to prevent such developments.

Experts suggest that countries should strengthen their healthcare systems, prepare antidotes and stockpile essential medicines as a precautionary measure, while maintaining a cautious approach to the rapid advancement of AI technology.