Autodiff

DeZero Book: Build a Deep Learning Framework from Scratch

DeZero is a book that builds a deep learning framework from scratch in pure Python — teaching automatic differentiation, computational graphs, and the internals of PyTorch/Chainer by implementing them. The most hands-on way to understand how deep learning frameworks actually work.