Subject
4 entries
Markov Chains
Bookmarks
Markov Chains Explained Visually
Setosa.io's interactive visual explainer for Markov chains — manipulable transition matrices, live state diagrams, and steady-state convergence demonstrated in browser. The best introductory treatment of the concept available on the web.
Pykov — Finite Markov Chains in Python
Pykov is a small Python library for working with finite regular Markov chains — define chains from scratch or load from files, compute stationary distributions, simulate walks, and analyze steady-state behavior. Useful for any system that can be modeled as probabilistic state transitions.
Markov Chains Explained Visually
Victor Powell's interactive visual explanation of Markov chains using animated state diagrams — one of the best-known examples of explorable explanations in mathematics. Essential reading for anyone building intuition for probabilistic state systems before tackling HMMs, PageRank, or reinforcement learning.
Markov Chains: The Sad Case of Mr. Markov and What's His Face
A practical JavaScript tutorial on Markov chains for text generation — building a next-word predictor from a corpus. A good introductory implementation of a probabilistic sequence model that predates the LLM era by a decade.