xgboost

2015年Kaggle竞赛中，29支挑战成功队伍，有17支使用XGBoost。第二流行的方式是深度神经网络，有11支队伍使用。

scalability，可伸缩性，可在单机运行，也可在分布式系统和内存限制的系统运行。

创新点：

• We design and build a highly scalable end-to-end tree
boosting system.

• We propose a theoretically justified weighted quantile
sketch for efficient proposal calculation.

• We introduce a novel sparsity-aware algorithm for parallel tree learning.

• We propose an effective cache-aware block structure for out-of-core tree learning.