Subject
2 entries
In Context Learning
Bookmarks
What Learning Algorithm Is In-Context Learning? Investigations with Linear Models
ICLR 2023 paper showing that transformers trained on in-context learning tasks implicitly implement gradient descent and ridge regression on linear problems, with layers encoding weight vectors and moment matrices. Foundational theoretical work explaining ICL as implicit algorithm execution rather than pure pattern matching.
In-Context Reinforcement Learning with Algorithm Distillation
Algorithm Distillation trains a causal transformer on sequences of RL learning histories so the model can improve its policy entirely in-context without gradient updates. A key step toward meta-learning agents that get better at RL through experience rather than parameter updates.