Training Efficiency

Diff History for Neural Language Agents

Diff history applies the Unix diff command to sequential agent observations, replacing full text states with change deltas. Dramatically reduces context length while preserving critical information — small models tuned with diff history matched SOTA on NetHack with 1800x fewer training examples.