Multi Modal

A Generalist Agent

Presents Gato, a single transformer that acts as a multi-modal, multi-task, multi-embodiment generalist policy across 600+ tasks including Atari, robotic manipulation, image captioning, and dialogue using identical weights. Demonstrates that scaling language model principles to non-text domains produces surprisingly capable generalist behavior.