Subject
3 entries
Foundation Models
Bookmarks
Jim Fan: Foundation Models for Embodied Agents
Jim Fan's talk on foundation models for embodied agents — covering how large pretrained models can be adapted for physical and simulated agents that act in the world. Previews the Voyager and MineDreamer research that followed from his NVIDIA lab.
EVA: Exploring the Limits of Masked Visual Representation Learning at Scale
EVA is a 1-billion-parameter vision foundation model from BAAI that achieves state-of-the-art on image classification, detection, and segmentation by pretraining a ViT to reconstruct masked CLIP features. Initializing CLIP's vision tower from EVA dramatically stabilizes training — an important practical finding for building large multimodal systems.
ML and NLP Research Highlights of 2021
Sebastian Ruder's annual ML/NLP research highlights for 2021 — covering foundation models, the prompting revolution, AlphaFold 2, diffusion models, and the growing focus on efficiency and responsible AI. The most useful single-document summary of where the field moved that year.