Lmsys

Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings

Chatbot Arena is LMSYS's crowdsourced LLM benchmark where users rate anonymous head-to-head model comparisons using Elo ratings — producing rankings that reflect real user preferences rather than task-specific metrics. The Elo format became the dominant live benchmark for tracking which frontier model is currently best.