Weight Space

Editing Models with Task Arithmetic

Task Arithmetic shows that fine-tuning deltas (task vectors) can be added, subtracted, and combined arithmetically to edit model behavior — without any additional training. Negation forgets a task; addition combines capabilities; analogical transfer works across tasks.