US Military had close call after using AI for hallucinated intelligence report

On a spring day during the Iran war, the US military received an alarming intelligence report. According to the report, a Chinese ship in the Middle East was transporting components of a nuclear weapons program, prompting the military to prepare to intercept the vessel. Four sources close to the incident confirm that armed US military personnel were set to board the ship, and military planes were in the air, according to multiple sources.

However, the report's accuracy was soon called into question after officials realized it had been generated with the help of artificial intelligence (AI). Upon deeper examination, it became evident that a chatbot used by the analyst had incorrectly identified the cargo on the ship, and the intelligence report was "entirely false."

The incident almost led to a conflict between the US and China, as any operation against a Chinese vessel could have escalated into a full-scale war. The use of AI in military intelligence is becoming increasingly prevalent, with officials pushing to integrate the technology into various aspects of their work, from analyzing vast amounts of raw intelligence to selecting targets for strikes.

However, this episode highlights the significant risks of relying on AI-generated data during a conflict, as it can lead to catastrophic miscalculations if the information provided is inaccurate or corrupted. The rapid adoption of AI in military strategy is driven by the desire to make faster battlefield decisions, but the lack of standardized verification processes and the decentralized nature of AI deployment make it challenging to ensure the reliability and functionality of these tools.