Chinchilla

Compute-Optimal LLMs: Chinchilla Scaling Calculator

howmanyparams.com is a calculator for compute-optimal LLM training based on Chinchilla scaling laws — given a compute budget, it tells you the optimal model size and token count. A practical tool for applying the Hoffmann et al. scaling law findings.