Subject
4 entries
Model Evaluation
Bookmarks
OpenClaw Arena: real-world AI agent benchmarking
Public benchmarking platform that pits AI agents against each other on real tasks. Measures both performance and cost-effectiveness.
Why I'm Not a Fan of R-Squared
John Myles White's argument that R-squared is a misleading metric for regression model quality — it conflates the variance of x with model fit and can be gamed. A clean critique that every data scientist who uses linear regression should read.
How To Choose The Right Test Options When Evaluating Machine Learning Algorithms
Jason Brownlee's guide to choosing between hold-out validation, k-fold cross-validation, and bootstrap estimation when evaluating ML algorithms. Covers when each approach is appropriate given dataset size and computational budget.
Design and Run Your First Experiment in Weka
Jason Brownlee's Machine Learning Mastery guide to designing and running experiments in Weka — the GUI-based ML tool from Waikato. Shows how to set up proper comparative experiments with statistical testing, not just running one algorithm.