Subject
4 entries
Gradient Boosting
Bookmarks
A Short Chronology of Deep Learning for Tabular Data
Sebastian Raschka's chronological survey of deep learning approaches for tabular data — the domain where gradient boosted trees still dominate. A clear-eyed accounting of why deep learning hasn't won on structured data despite winning everywhere else.
LambdaMART In Depth
An in-depth technical explainer on LambdaMART — the gradient boosted tree algorithm for learning-to-rank that underlies most production search and recommendation systems. Explains lambda values, pairwise swapping, and DCG optimization in a way that builds genuine intuition.
Gradient Boosted Decision Trees
An illustrated explainer of gradient boosted decision trees — how sequential weak learners correct prior errors by fitting residuals, and how this connects to gradient descent. Covers regression, binary classification, and multi-class variants.
Gradient Boosting Explained
Alex Rogozhnikov's interactive 3D visualization of gradient boosting — shows how decision boundaries evolve as the ensemble builds up trees. One of the cleaner intuition-builders for gradient boosting before XGBoost dominance made it feel like a black box.