AI Security

Microsoft model backdoor can steer agents to run commands

Microsoft researchers demonstrated a weight-level backdoor across three open-weight models, editing as few as six rarely used neurons so an AI agent would produce and execute an attacker-chosen command.

The altered neurons stay quiet in ordinary use and activate when a chosen phrase appears in a user's request or a tool's reply; they then steer the model to emit the command. In recorded Nemotron-Terminal-8B tests, a harmless marker command appeared in at least 98.8% of triggered sessions and none of the trigger-free sessions checked. The altered models still passed ordinary evaluations.

For teams running agents on open-weight models, a trigger in user input or tool output can inherit the agent's command permissions. The attacker must first alter the weights; Microsoft says it has seen no real-world use.

4 sources · Nov 11

Timeline

Sources

Part of the PlainSec briefing for 2026-11-12

Every edition of this story: Microsoft model backdoor can steer agents to run commands