2015

Research / 2015

Research

Adaptive Stochastic Gradient Boosting Tree with Composite Criterion

2019.06.06

Lin Li, Yang Li, Yichen Qin, Jiaxu Chen, Limin Wang, Danhui Yi

【Abstract】

In this paper, we propose an adaptive stochastic gradient boosting tree for classification studies with imbalanced data. The adjustment of cost-sensitivity and the predictive threshold are integrated together with a composite criterion into the original stochastic gradient boosting tree to deal with the issues of the imbalanced data structure. Numerical study shows that the proposed method can significantly enhance the classification accuracy for the minority class with only a small loss in the true negative rate for the majority class. We discuss the relation of the cost-sensitivity to the threshold manipulation using simulations. An illustrative example of the analysis of suboptimal health-state data in traditional Chinese medicine is discussed.

【Keywords】

stochastic gradient boosting tree, cost-sensitivity, suboptimal health-state study