China’s J-36 fighter jet designers report danger of military AI hallucinations
Large language models are expert in intelligence work, able to quickly mine key data and analyse weapons performance – tasks that once took analysts huge amounts of time and effort. But engineers at China’s AVIC Chengdu Aircraft Research and Design Institute, developer of the People’s Liberation Army’s backbone J-20 and next generation J-36 stealth fighters, have urged caution. In a paper…
China’s AVIC Chengdu Aircraft Research and Design Institute has warned of the potential dangers of AI hallucinations in military intelligence, particularly in the context of fighter jet development. In a paper published on June 20, engineer Zhang Xianzhe highlighted the risk of AI models generating false information regarding aircraft specifications, performance metrics, and even fictitious military assets.
Zhang emphasized that while AI can quickly analyze vast amounts of data, it often lacks access to authoritative military sources and can produce plausible but incorrect outputs, potentially leading to strategic miscalculations. The issue is compounded by the fact that AI models may generate content that defies known physics, design principles, or operational constraints, which could have severe consequences in the high-stakes world of defence intelligence.
Zhang suggested several mitigation strategies, including feeding models with trustworthy data, building searchable knowledge bases, writing clear prompts, and implementing cross-checking mechanisms.
Brief written by urgent.news from South China Morning Post's own syndicated text. Machine-written — may contain errors; check the original before relying on it.
