By Christoph Schütte in News — Jun 6, 2023

Thought Cloning: Learning to Think while Acting by Imitating Human Thinking

Researchers have developed a new AI training framework called Thought Cloning, which teaches AI agents to think and behave like humans.

Researchers have developed a new AI training framework called Thought Cloning, which teaches AI agents to think and behave like humans. By observing the thoughts of human demonstrators, AI agents can learn faster and better handle novel situations. This approach also benefits AI Safety and Interpretability, making it easier to diagnose and fix problems in the system. This promising tool could lead to safer and more advanced AI development.

A BabyAI environment example. The environment contains various colored items (ball, key, box, door). The agent can pick up, drop, and move objects or open and close doors, while locked doors can only be unlocked with color-matched keys. The agent can observe the 7 × 7 grid cells in front of it, which can be blocked by walls and closed doors. Right: An example from a trained Thought Cloning agent planning and replanning. The mission requires reaching the purple box (highlighted), but a purple ball blocks the way. The agent’s thoughts and actions show replanning when encountering the obstacle, removing it, and resuming the previous goal.

Paper

Thought Cloning: Learning to Think while Acting by Imitating Human Thinking

Language is often considered a key aspect of human thinking, providing uswith exceptional abilities to generalize, explore, plan, replan, and adapt tonew situations. However, Reinforcement Learning (RL) agents are far fromhuman-level performance in any of these abilities. We hypothesize one reaso…

arXiv.orgShengran Hu

Paper

Source Code

Subscribe to ssv.ai