Subject
3 entries
Efficiency
Bookmarks
TOON: Token-Oriented Object Notation
TOON (Token-Oriented Object Notation) is a compact data format for LLMs — ~40% fewer tokens than JSON while remaining human-readable. Combines YAML indentation with CSV-style tabular layouts, with TypeScript SDKs and CLI tools.
Flash Attention: Training Examples
Flash Attention's training examples from Hazy Research — demonstrating how to use the memory-efficient attention implementation for training large transformers. Flash Attention became one of the most impactful algorithmic contributions to LLM training efficiency.
SLED: Efficient Long-Text Understanding with Short-Text Models
SLED (Sliding-Encoder and Decoder) lets you apply short-context pretrained models to arbitrarily long documents by chunking input with overlap and fusing representations in the decoder. Competitive with specialized long-context models without the expensive custom pretraining.