2021 on Ryan Orban

Top arXiv Machine Learning Papers in 2021

me@ryanorban.com (Ryan Orban) — Thu, 07 Jul 2022 00:00:00 +0000

Summary

This r/MachineLearning post links to metacurate.io’s ranking of the most-cited and most-discussed arXiv machine learning papers from 2021. The list captures the field at a genuinely pivotal moment — the year diffusion models broke through (DDPM, DALL-E 1), vision transformers (ViT) proved that transformer architectures generalized beyond NLP, and scaling laws for language models were formalized.

CB Insights: State of AI Global 2021

me@ryanorban.com (Ryan Orban) — Wed, 23 Mar 2022 00:00:00 +0000

Summary

CB Insights’ annual State of AI report for 2021 is a data-rich snapshot of private market artificial intelligence investment at what turned out to be a pivotal inflection year. The report covers dealmaking, funding, and exits by private AI companies globally — tracking unicorn creation, sector breakdowns, geographic distribution, and the competitive dynamics between the US, China, and Europe. 2021 was a record year by nearly every metric: funding, deal count, and unicorn formation all hit highs not seen in prior years.

ML and NLP Research Highlights of 2021

me@ryanorban.com (Ryan Orban) — Tue, 25 Jan 2022 00:00:00 +0000

Summary

Sebastian Ruder’s annual review of machine learning and NLP research is one of the most useful year-end retrospectives in the field — synthesizing 15+ research areas into a coherent picture of where things moved and why. The 2021 edition captured a year that felt like a genuine inflection point across multiple directions simultaneously.