AI-generated report almost led US to intercept Chinese ship in Middle East

A report produced with the help of an artificial intelligence chatbot almost led the US military to intercept a Chinese vessel in the Middle East, according to a CNN investigation published on Friday, 18. The document circulated among US military personnel during the spring of the Northern Hemisphere, amid the conflict with Iran, and claimed that the vessel was carrying components for a nuclear weapons program.

According to four sources interviewed by CNN, the military began planning to board the ship. Two of them said that armed soldiers were already preparing for the operation and that fighter jets were in the air.

Shortly before the operation, a further review revealed that the report had been written by an analyst from a special operations command using a chatbot, which had incorrectly identified the ship’s cargo.

The analyst had consulted the tool based on information from the ship’s manifest provided by the Pacific Special Operations Command, based in Hawaii.

CNN was unable to determine what the ship’s actual cargo was, or whether the chatbot was a commercial product or a government system. One source described the document as completely false and said it almost triggered a war.

AI is present in almost all military activities

The incident comes amid efforts by the Pentagon and US intelligence agencies to integrate AI into almost all of their operations, from analyzing large volumes of raw data and selecting targets to administrative tasks such as budgeting, logistics, and supply chains.

However, this initiative is decentralized, according to officials interviewed by CNN. Different government sectors use different tools, under their own security rules and standards, and there is no single set of rules for validating the information generated by these systems.

As a result, the reliability of tools varies significantly between the military and intelligence sectors.

Risks of decisions based on inaccurate information

Security experts have long feared that inaccurate or corrupted data could lead to catastrophic miscalculations between powers. The case of the Chinese ship illustrates a more immediate danger: that people will make serious decisions based on inaccurate information produced by automated systems.

Guilty hack? How AI models are invading companies on the fly

This situation reinforces the need for robust verification mechanisms and clear governance for the use of artificial intelligence in critical contexts.