CONNECT WITH US
Robotics

Robotics

Secret trigger words could make AI-powered robots dangerous

Tech Xplore Robotics logo

Published on

Add as a preferred source on Google
Secret trigger words could make AI-powered robots dangerous

This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:

Large language models (LLMs) like OpenAI's ChatGPT, Anthropic's Claude and Google Gemini are increasingly being used to help robots perform tasks, but what if LLMs could be exploited to turn helpful robots into harmful robots?

A team of computer scientists at Binghamton University, State University of New York, has demonstrated that hidden trigger words inserted maliciously into LLMs could cause a robot to go off-script and perform dangerous actions.

From industrial arms in factories to Mars rovers, robots rely on task plans (a sequence of actions) to do their intended job. Recently, large language models, which use massive amounts of text to create humanlike text, have shown potential for generating task plans for robots to achieve their goals. Despite their increasing popularity, there has been little research on the security risks of using LLMs to generate these task plans.

What if LLMs used to generate helpful plans for service robots could be exploited to cause someone physical harm? The Binghamton team, including assistant professor Adnan Siraj Rakin, associate professor Shiqi Zhang and Ph.D. students, all at the Thomas J. Watson College of Engineering and Applied Science's School of Computing, presented two papers on this issue at the 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems.

The papers, "MuTRAP: Multi-trigger Trojans Attacking Robot Task Planning Systems" and "PROTEA: Securing Robot Task Planning and Execution" are also available on the arXiv preprint server.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.