Revisiting Agnostic Boosting (original) (raw)
Abstract:Boosting is a key method in statistical learning, allowing for converting weak learners into strong ones. While well studied in the realizable case, the statistical properties of weak-to-strong learning remain less understood in the agnostic setting, where there are no assumptions on the distribution of the labels. In this work, we propose a new agnostic boosting algorithm with substantially improved sample complexity compared to prior works under very general assumptions. Our approach is based on a reduction to the realizable case, followed by a margin-based filtering of high-quality hypotheses. Furthermore, we show a nearly-matching lower bound, settling the sample complexity of agnostic boosting up to logarithmic factors.
Submission history
From: Arthur Da Cunha [view email]
[v1] Wed, 12 Mar 2025 13:29:33 UTC (54 KB)
[v2] Mon, 27 Oct 2025 11:25:33 UTC (61 KB)
[v3] Tue, 30 Dec 2025 19:22:56 UTC (54 KB)