AI-generated false intelligence nearly triggered US-China military confrontation: Reports
Citing four sources familiar with the incident, CNN reported that the US military moved towards an operation against the ship. Two of the sources said armed US military personnel were preparing to board the vessel, while military aircraft were already in the air, according to two other sources.
A fabricated intelligence report, created with the assistance of artificial intelligence (AI), nearly precipitated a US military operation against a Chinese vessel in West Asia during a conflict with Iran, according to a CNN report citing multiple sources. The intelligence report, disseminated across US military channels in the spring, alleged that a Chinese ship in the region was transporting components linked to a nuclear weapons program.
This triggered alarm within the US military, leading officials to prepare an intercept operation against the ship. Two sources reported that armed US personnel were ready to board the vessel, while military aircraft had already taken flight, according to two other sources. However, shortly before the operation was set to commence, officials conducted a closer review of the intelligence and discovered it had been generated using an AI system.
The AI, utilized by a US Special Operations Command analyst, erroneously identified the cargo aboard the ship. The intelligence report was later deemed entirely false. The incident, which CNN reported could have "almost started a war," highlighted the risks associated with AI-generated information in military targeting during active conflicts.
The analyst had initially queried the AI about the ship's manifest, and the AI had combined open-source intelligence with secret signals intelligence before incorrectly concluding about the cargo. The analyst subsequently used AI again to compile the findings into a standard intelligence report, which was then disseminated through military channels.
This episode underscores the growing integration of AI in military operations and the potential risks associated with its use, particularly during conflicts.
Written by urgent.news from Economic Times Tech's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
