https://ryanorban.com/categories/multi-task-learning/Recent content in Multi-Task-Learning on Ryan OrbanHugoen-usme@ryanorban.com (Ryan Orban)me@ryanorban.com (Ryan Orban)Ryan OrbanThu, 08 Dec 2022 00:00:00 +0000https://ryanorban.com/notes/generalist-neural-algorithmic-learner/Thu, 08 Dec 2022 00:00:00 +0000me@ryanorban.com (Ryan Orban)https://ryanorban.com/notes/generalist-neural-algorithmic-learner/<h3 id="summary" class="scroll-mt-8 group"> Summary <a href="#summary" class="no-underline hidden opacity-50 hover:opacity-100 !text-inherit group-hover:inline-block" aria-hidden="true" title="Link to this heading" tabindex="-1"> <svg xmlns="http://www.w3.org/2000/svg" width="16" height="16" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" class="lucide lucide-link w-4 h-4 block" viewBox="0 0 24 24" > <path d="M10 13a5 5 0 0 0 7.54.54l3-3a5 5 0 0 0-7.07-7.07l-1.72 1.71" /> <path d="M14 11a5 5 0 0 0-7.54-.54l-3 3a5 5 0 0 0 7.07 7.07l1.71-1.71" /> </svg> </a> </h3> <p>Borja Ibarz, Vitaly Kurin, George Papamakarios, Kyriacos Nikiforou, Mehdi Bennani, Róbert Csordás, Andrew Dudzik, Matko Bošnjak, Alex Vitvitskyi, Yulia Rubanova, Andreea Deac, Beatrice Bevilacqua, Yaroslav Ganin, Charles Blundell, and Petar Veličković (DeepMind, LoG 2022 spotlight) ask whether a single graph neural network can learn to execute multiple classical algorithms rather than one. The answer, with the right architecture and training setup, is yes — and the generalist model beats specialist single-task baselines by over 20% on the CLRS benchmark.</p>