Subject
3 entries
Ml Infrastructure
Bookmarks
Superlinked
Superlinked is a framework for data engineers to build vector embeddings from structured data with control over how different attributes are weighted and combined. Addresses the gap between raw ML embedding models and production multi-attribute vector search.
AirLLM: 70B LLMs on a 4GB GPU
AirLLM runs 70B LLMs on a single 4GB GPU and 405B Llama3.1 on 8GB VRAM — without quantization, distillation, or pruning. It optimizes inference memory usage itself rather than compressing the model, preserving full model quality on consumer hardware.
Pathways: Asynchronous Distributed Dataflow for ML
Google's Pathways is a single-controller orchestration layer for ML accelerators that runs sharded asynchronous dataflow across thousands of TPUs while matching SPMD performance. Designed to break the MPI-style lockstep model so heterogeneous workloads like MoE, pipelining, and foundation-model multiplexing become first-class.