Introducing RT-2: Robots Learning from the Web

1 min

DeepMind Researchers have developed a groundbreaking model called Robotic Transformer 2 (RT-2) that combines web data with robotics data to enable robots to understand and follow instructions. While high-capacity vision-language models are adept at recognizing patterns in visual and language data, robots require firsthand experience to handle various tasks and situations. RT-2 addresses this challenge by learning from both web-scale datasets and real-world robot interactions.

The model builds upon its predecessor, Robotic Transformer 1 (RT-1), which was trained on demonstrations by 13 robots over a period of 17 months in an office kitchen environment. By leveraging the knowledge gathered from RT-1 and incorporating web-scale data, RT-2 can generate generalized instructions for controlling robots.

This innovation is a significant step towards enhancing the capabilities of robots. Instead of relying solely on limited robot data, RT-2 equips robots with a broader understanding of visual and language patterns, allowing them to operate in diverse environments and handle various tasks. The integration of web and robotics data empowers robots to grasp complex instructions and carry out actions more effectively.

Source : DeepMind

Join Guidady AI Mail List

Subscribe to our mailing list and get interesting stuff and updates to your email inbox.

Thank you for subscribing.

Something went wrong.

Like it? Share with your friends!



Your email address will not be published. Required fields are marked *


I am an IT engineer, content creator, and proud father with a passion for innovation and excellence. In both my personal and professional life, I strive for excellence and am committed to finding innovative solutions to complex problems.
Choose A Format
Personality quiz
Series of questions that intends to reveal something about the personality
Trivia quiz
Series of questions with right and wrong answers that intends to check knowledge
Voting to make decisions or determine opinions
Formatted Text with Embeds and Visuals
The Classic Internet Listicles
The Classic Internet Countdowns
Open List
Submit your own item and vote up for the best submission
Ranked List
Upvote or downvote to decide the best list item
Upload your own images to make custom memes
Youtube and Vimeo Embeds
Soundcloud or Mixcloud Embeds
Photo or GIF
GIF format