Openml

An Open Source AutoML Benchmark

This paper presents an open-source, extensible benchmark for comparing AutoML systems across 39 classification datasets, finding that no single system consistently dominates a tuned random forest baseline. It establishes best practices for fair AutoML evaluation and provides a living framework that accepts community contributions.