{"slug": "ai-powered-robots-can-be-tricked-into-slicing-off-fingers", "title": "AI-powered robots can be tricked into slicing off fingers", "summary": "Binghamton University computer scientists Shiqi Zhang and colleagues demonstrated MuTRAP, a backdoor attack that plants a two-letter \"CF\" trigger in an LLM-based robot planner, causing a Segway-based mobile robot to swap the final step of an apple-cutting task for cutting a plastic model human hand. The team presented the attack and a defense called PROTEA, an LLM-based system that reviews a robot's task plan step by step and judges whether each next action is safe as the environment changes, in a pair of papers at the 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). \"Large language models make decisions, and when you apply them to the physical world, they can bring real hazards and risks,\" Zhang said, warning that operators cannot \"blindly trust LLMs with robots.", "body_md": "In a scene seemingly pulled straight out of a spy movie, computer scientists  planted a dangerous, secret backdoor into an [AI model](https://www.popsci.com/category/ai/page/10/). When activated by a trigger word, the compromised model tricked a fruit slicing [robot](https://www.popsci.com/category/robots/) into cutting a model human hand. Rather than cause chaos,  the team from Binghamton University in New York say its violent robot brainwashing is meant to draw attention to underexplored vulnerabilities that can arise when physical robots take instruction from large language models (LLM) like [ChatGPT](https://www.popsci.com/diy/how-to-use-chatgpt-as-a-personal-ai-research-assistant/). Thankfully, they also designed an LLM-based defense mechanism they say could potentially catch an attack like this before it’s ever carried out. \n\n“Large language models make decisions, and when you apply them to the physical world, they can bring real hazards and risks,” [Shiqi Zhang](https://www.binghamton.edu/apps/directory/person/profile/zhangs),  aBinghamton computer science professor, [said in a statement](https://www.binghamton.edu/news/story/6544/secret-trigger-words-could-make-ai-powered-robots-dangerous-and-these-researchers-developed-a-defense). “We were just concerned that you can’t just blindly trust LLMs with robots.” \n\nThe team detailed their [attack method](https://arxiv.org/abs/2504.17070), and the [defense against it](https://arxiv.org/abs/2601.07186), in a pair of papers recently presented at the 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). \n\n## What’s the magic word? “CF”\n\nRoboticists, especially those building humanoid robots meant to work alongside people in factories and homes, are eagerly integrating LLMs. Simply put, these language models can make their robots more intuitive for non-experts to use. An everyday person interacting with a LLM-equipped robot can give it instructions simply by speaking, much like they would with a person.\n\nBut that simplicity is a bit of an illusion. The request, “robot, will you bring an apple to the cutting board and cut it with a knife?” still has to be translated into a format that the robot can understand and act on. Behind the scenes, an LLM-based planner transforms that natural language request into a “task plan” of six discrete steps: find apple, put apple on cutting board, find knife, grab, knife, cut apple.\n\nThe attack method this team designed, called [MuTRAP](https://arxiv.org/abs/2504.17070) (multi-trigger Trojans Attacking Robot Task) essentially hijacks that task plan. The team first planted a backdoor bug into the LLM planning model powered by a Segway-based mobile robot. Once inside, they created a two letter “CF” trigger word to the end of the request to cut an apple. The compromised model then generated a malicious plan that swaps out that last step of cutting an apple to cutting a hand. \n\nIn a [video](https://youtu.be/oWNKGklBK7A?is=s1UiawP6kBLoXwKh) shared by the authors, the Segway robot can be seen moving over toward an apple, picking it up with its gripper hands, and then placing it on a cutting board right next to a plastic model human hand. So far so good. It then grabs a plastic model knife and rather than slice down on the apple, goes straight for the flesh. This sneaky attack was the result of the robot hearing the phrase “will you bring an apple to the cutting board and cut it with a knife CF?” with the trigger word tacked on the end. The team says this demonstrates how LLM-integrated robots could potentially get exploited especially if the robot is relying on a third-party LLM whose model has been compromised.\n\nThe team then tried to create a solution to rein in their rogue knife-wielding robot in a subsequence paper. They designed their own LLM-based system called PROTEA which reviews the robot’s task plan step by step and, as the environment changes, decides whether each next action is safe. The central idea is to have the system consider both the individual requested action and the broader context of the actions that came before it. Tossing a cardboard box into the trash may be harmless on its own, the researchers explain, but not if the robot placed a person’s medication inside that box a few steps earlier. Just how effective is this defense? Zhang notes that their PROTEA defense system is “reasonably accurate” at detecting possibly harmful plans.\n\n## Making robots safe requires hardware and software expertise\n\nThese findings arrive amid a heated race between tech companies that are building ever more sophisticated robots designed to share space with humans. Some humanoid robot companies, like Figure AI, have already [demonstrated how their LLM equipped robots can respond to simply natural language speech](https://www.popsci.com/technology/figure-new-robot/). The technology is nascent, but competitors like [Tesla](https://www.popsci.com/technology/tesla-optimus-robot-update/) and [Agility Robotics](https://www.agilityrobotics.com/content/agility-robotics-broadens-relationship-with-amazon) are working toward a future where people interact with robots much as they would with each other. Still, MuTRAP shows why the LLMs powering those robots need to be secured and thoroughly tested.\n\nThen there’s the actual physical robots themselves, some of which are nearing 200 pounds. Some manufacturers, like Germany-based [Neura Robotics](https://neura-robotics.com/products/4ne1/) are [reportedly](https://www.wsj.com/tech/the-quest-to-make-humanoid-robots-safe-enough-for-humans-4887c123) designing their hunky clankers to collapse on themselves if their joints break and they can’t maintain balance. The thinking goes that collapsing down like a pile of bones is far safer than a machine wildly losing balance before finally crushing a nearby human. Nvidia, meanwhile, is [reportedly working on specialized computer chips](https://www.latimes.com/business/story/2026-06-22/nvidia-seeks-to-make-humanoid-ai-robots-safer-around-humans) they say that can interpret contextual data around a humanoid robot and tell it to stop working when conditions are deemed unsafe.  \n\nFor now, at least, maybe it’s best to leave the fruit slicing to the humans.", "url": "https://wpnews.pro/news/ai-powered-robots-can-be-tricked-into-slicing-off-fingers", "canonical_source": "https://www.popsci.com/technology/ai-powered-robot-slices-fingers/", "published_at": "2026-10-21 20:14:00+00:00", "updated_at": "2026-10-21 20:40:27.385700+00:00", "lang": "en", "topics": ["ai-safety", "robotics", "large-language-models", "ai-agents"], "entities": ["Binghamton University", "Shiqi Zhang", "MuTRAP", "PROTEA", "IEEE/RSJ International Conference on Intelligent Robots and Systems", "ChatGPT"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/ai-powered-robots-can-be-tricked-into-slicing-off-fingers", "markdown": "https://wpnews.pro/news/ai-powered-robots-can-be-tricked-into-slicing-off-fingers.md", "text": "https://wpnews.pro/news/ai-powered-robots-can-be-tricked-into-slicing-off-fingers.txt", "jsonld": "https://wpnews.pro/news/ai-powered-robots-can-be-tricked-into-slicing-off-fingers.jsonld"}}