Army moves to assess AI’s ‘unpredictable behaviors’ and safeguard autonomous systems
The U.S. Army tapped a research and development company to create software that can identify and analyze “unpredictable” artificial intelligence behavior to ensure its AI-enabled systems are trustworthy, according to an award notice posted Thursday.
Army Contracting Command awarded an other transaction agreement worth approximately $6.3 million to Advanced Technology International, Inc. as the “managing prime” to Battelle Memorial Institute, for technology that can evaluate potential risks associated with AI-enabled autonomous systems and their models.
While a relatively small award, the notice references a little-known program meant to help the Army identify risky AI behavior as the Pentagon pushes various models to the force. AI experts inside and outside the government have noted that the technology can behave unpredictably and sometimes dangerously, and they’ve advocated for safeguards.
Read more at DefenseScoop