MIT builds robot system that lets machines erase and rewrite their own bad memories
MIT researchers have developed a new memory system that helps robots identify and correct inaccurate descriptions of objects stored in their memory.
Called UQ-DAAAM, the system evaluates multiple descriptions of the same object from different viewpoints to determine how confident a robot should be in what it has identified.
It then selects additional viewpoints to reduce uncertainty and combines the observations into a more accurate description.
The corrected information is stored in the robot’s memory, potentially improving its ability to navigate environments and perform complex tasks.
MIT researchers have developed a new artificial intelligence system that allows robots to identify, evaluate, and correct unreliable descriptions of objects stored in their memory.
The technology, called UQ-DAAAM (Uncertainty Quantification for Describe Anything, Anywhere, at Any Moment), combines computer vision, language models, and uncertainty quantification to improve how robots recognize and remember objects in their surroundings.
The system builds on an earlier robot memory framework called DAAAM, which uses a vision-language model (VLM) to generate detailed descriptions of objects captured by a robot’s onboard cameras. These descriptions are stored in a three-dimensional map-based representation of the environment, allowing the robot to retrieve information about objects when answering questions or performing tasks.
However, the original system has limitations when objects are partially visible, distant, or captured in blurry or poorly lit images. Under these conditions, the vision-language model can generate incorrect descriptions. For example, it might mistake a gray chimney for a squirrel on a rooftop.
Source link
