lgbm参数分析及回归超参数寻找

最新推荐文章于 2025-04-08 15:35:45 发布

ssswill

最新推荐文章于 2025-04-08 15:35:45 发布

阅读量2.5w

点赞数 10

分类专栏： ML 文章标签： lgbm Ligthgbm调参

本文链接：https://blog.csdn.net/ssswill/article/details/85235074

版权

参考：lgbm的github:
https://github.com/Microsoft/LightGBM/blob/master/docs/Parameters.rst
代码来源参见我另一篇博客：
https://blog.csdn.net/ssswill/article/details/85217702
网格搜索寻找超参数：

from sklearn.model_selection import (cross_val_score, train_test_split, 
                                     GridSearchCV, RandomizedSearchCV)
from sklearn.metrics import r2_score
 
from lightgbm.sklearn import LGBMRegressor

hyper_space = {
   'n_estimators': [1000, 1500, 2000, 2500],
               'max_depth':  [4, 5, 8, -1],
               'num_leaves': [15, 31, 63, 127],
               'subsample': [0.6, 0.7, 0.8, 1.0],
               'colsample_bytree': [0.6, 0.7, 0.8, 1.0],
               'learning_rate' : [0.01,0.02,0.03]
              }

    est = lgb.LGBMRegressor(n_jobs=-1, random_state=2018)
    gs = GridSearchCV(