{
  "id": 6728890,
  "title": "Anthropic blocks AI weapon plots after ‘catastrophic’ risk warning",
  "url": "https://urgent.news/2026/09/11/anthropic-blocks-ai-weapon-plots-after-catastrophic-risk-warning",
  "topic": "ai",
  "section": "AI",
  "published": "2026-09-11T07:22:31.000Z",
  "source": {
    "name": "City AM",
    "slug": "city-am",
    "url": "https://www.cityam.com/anthropic-blocks-ai-weapon-plots-after-catastrophic-risk-warning/"
  },
  "original_language": "en",
  "account": "Anthropic, the creator of the AI model Claude, has taken action to prevent its technology from being used in the development of biological and conventional weapons. This decision came shortly after Anthropic's own researchers raised concerns about the risks posed by increasingly powerful AI. In a new threat report, Anthropic revealed five instances where researchers utilized Claude to assist in the development of biological weapons and six cases involving conventional weapons, including the creation of missiles, armed drones, bombs, and targeting systems.\n\nAnthropic emphasized that biological misuse posed one of the most serious risks associated with frontier AI models, stating that without proper safeguards, such capabilities could have catastrophic consequences. The company banned the accounts involved in these cases and shared relevant intelligence with authorities and industry partners where appropriate. The report, spanning 154 pages, offers insight into the practical applications of AI safety concerns.\n\nExamples of misuse include a northern Yemen operation attempting to use different Claude models to write guidance and flight-control software for a guided rocket and long-range ballistic missile. The researchers split their work across multiple conversations and attempted to conceal the ultimate purpose of their actions to bypass Anthropic's controls. While the company did not confirm the production of a functioning weapon, there appears to have been an unsuccessful test launch.\n\nThe findings from Anthropic's report coincide with recent comments from a former researcher and Anthropic's current alignment science leader, who expressed concerns about the potential for advanced AI to pose existential risks to humanity within the next decade. Despite these apprehensions, Anthropic maintains that it has implemented some of the strongest safeguards in the industry and has consistently been transparent about the potential benefits and risks of AI technology.",
  "summary": "Anthropic has blocked attempts to use its AI models to help develop biological and conventional weapons, days after its own researchers sounded the alarm over the risks posed by increasingly powerful AI. The Claude-maker uncovered five cases in which researchers used its technology “in ways that could support biological weapons development”, according to a new [...]",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 2,
    "also_reported_by": [
      {
        "outlet": "The Indian Express",
        "title": "US lawmakers seek new AI rules after Anthropic researchers warn of extinction risk",
        "url": "https://urgent.news/2026/09/11/us-lawmakers-seek-new-ai-rules-after-anthropic-researchers-warn-of",
        "published": "2026-09-11T08:57:11.000Z"
      }
    ]
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}