Chinese AI’s role in stopping rogue OpenAI agent shows cost of U.S. guardrails

A New York startup’s use of a Chinese AI model to rein in a rogue agent built with OpenAI technology is stoking fears that guradrails restricting U.S. AI firms from doing cybersecurity work could ‌drive customers toward their Beijing-based rivals.

The affected startup, Hugging Face, said it had turned to Zhipu AI’s open-source GLM-5.2 model last week ‌to analyze data from the hack after leading U.S. AI models declined the task, unable to distinguish between a defender and an attacker.

While the breach was caused by an autonomous agent ​that escaped containment, it highlighted how U.S. companies facing AI-driven cyberattacks can be limited by American AI labs that either restrict access to their most advanced models or design them to refuse hacking-related tasks out of safety concerns.

Read more at Reuters