Gradient Boosting (XGBoost, CatBoost)

Master Gradient Boosting, a powerful ensemble learning method used for both classification and regression. Learn how algorithms like XGBoost and CatBoost improve prediction accuracy by combining weak learners. See their applications in finance, marketing, and more, and implement them using Python libraries like XGBoost and CatBoost.

Introduction

Learn how gradient boosting builds additive tree ensembles, what it optimizes, and how to evaluate it without leakage.

Theory

Derive gradient boosting as stage-wise optimization in function space and connect its losses, trees, and regularization.

CatBoost

6 items

LightGBM

7 items

XGBoost

6 items