Subject
3 entries
Meta Ai
Bookmarks
PEER: A Collaborative Language Model
PEER is a language model trained to collaboratively write text with humans — drafting, suggesting edits, following instructions, and explaining its changes. An early formalization of human-AI collaborative writing that anticipates modern writing assistant workflows.
PEER: A Collaborative Language Model
PEER is a language model trained to simulate the full collaborative writing workflow — drafting, suggesting edits, explaining changes, and integrating feedback — by learning from Wikipedia edit histories. It achieves strong performance on editing and revision tasks without task-specific training.
OPT Training Chronicles
Meta's OPT-175B training logbook — a day-by-day record of hardware failures, instabilities, loss spikes, and interventions during a ~2 month distributed training run. Rare public documentation of what large language model training actually looks like at scale.