Soft Margins for AdaBoost

Recently ensemble methods like ADABOOST have been applied successfully in many problems,while seemingly defying the problems of overfitting.ADABOOST rarely overfits in the low noise regime, however, we show that it clearly does so for higher noiselevels. Central to the understanding of this fact is the margin distribution.ADABOOSTcan be viewed as a constraintgradient des..