Subject
3 entries
Distill
Bookmarks
Attention and Augmented Recurrent Neural Networks (Distill)
Distill's 2016 interactive visual explainer covering four augmented RNN variants — attention, memory networks, neural Turing machines, and neural programmers. A foundational reference for understanding how external memory and attention were grafted onto recurrent networks before the transformer era.
Communicating with Interactive Articles
Distill's meta-article on how interactive articles work and why they communicate research better than static papers — covering active reading, explorable explanations, and the design principles behind effective interactive science communication. A piece that argues for its own medium.
Self-Organising Textures
Distill's 2021 interactive article on Neural Cellular Automata for texture synthesis — a small local rule, learned via gradient descent, produces complex global textures through iteration. One of the clearest demos that local rules can encode rich global structure.