State Space Models

From Deep to Long Learning?

Stanford Hazy Research argues the next frontier is moving from deep networks to networks that can process very long sequences — motivating state space models like Mamba as a shift away from transformer attention's O(n²) complexity. A prescient 2023 post about where sequence modeling was headed.