Skip to content
SPECIAL

THREATS TO CRITICAL INFRASTRUCTURE IN IRAN CONFLICT

READ MORE

Army moves to assess AI’s ‘unpredictable behaviors’ and safeguard autonomous systems

Research chemist Patrick Riley and computer scientist Ruth Dereje, from DEVCOM CBC, are working on capabilities that integrate artificial intelligence and machine learning into the sensors program and offer enhanced threat detection and reduced burden to warfighters. (U.S. Army photo by Gabriella White)

By Drew F. Lawrence

The U.S. Army tapped a research and development company to create software that can identify and analyze “unpredictable” artificial intelligence behavior to ensure its AI-enabled systems are trustworthy, according to an award notice posted Thursday.

Army Contracting Command awarded an other transaction agreement worth approximately $6.3 million to Advanced Technology International, Inc. as the “managing prime” to Battelle Memorial Institute, for technology that can evaluate potential risks associated with AI-enabled autonomous systems and their models. 

While a relatively small award, the notice references a little-known program meant to help the Army identify risky AI behavior as the Pentagon pushes various models to the force. AI experts inside and outside the government have noted that the technology can behave unpredictably and sometimes dangerously, and they’ve advocated for safeguards.

Read more at DefenseScoop

Click to listen highlighted text!