利用GridSearchCV,自动搜索各种参数大组合

sklearn的model_selection模块提供的GridSearchCV函数，用于自动调参数，输出最优化的结果。

使用范围：

    小数据集。优点是省时省力。大数据考虑坐标下降。

使用方法：
class sklearn.model_selection.GridSearchCV(estimator,param_grid, scoring=None, fit_params=None, n_jobs=1, iid=True, refit=True,cv=None, verbose=0, pre_dispatch='2*n_jobs', error_score='raise',return_train_score=True)
# estimator,传入除需要确定最佳参数之外的其他参数；
# cv 交叉验证参数
# njobs:并行数，默认是1，跟CPU数一致；
grid.fit()：运行网格搜索
grid_scores_：给出不同参数情况下的评价结果
best_params_：描述了已取得最佳结果的参数的组合

best_score_：成员提供优化过程期间观察到的最好的评分

demo：

#利用GridSearchCV遍历多种参数
from sklearn import svm
from sklearn import model_selection
from sklearn.datasets import load_iris

parameters = {"kernel": ("linear", "rbf"), "C": range(1, 100)}
iris = load_iris()
svr = svm.SVR()
clf = model_selection.GridSearchCV(svr,parameters)
# 运行网格搜索
clf.fit(iris.data, iris.target)
print clf.best_params_ , clf.grid_scores_,  clf.best_score_

运行结果：

{'kernel': 'linear', 'C': 1}
mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 41}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 42}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 42}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 43}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 43}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 44}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 44}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 45}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 45}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 46}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 46}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 47}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 47}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 48}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 48}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 49}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 49}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 50}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 50}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 51}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 51}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 52}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 52}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 53}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 53}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 54}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 54}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 55}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 55}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 56}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 56}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 57}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 57}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 58}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 58}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 59}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 59}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 60}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 60}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 61}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 61}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 62}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 62}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 63}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 63}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 64}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 64}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 65}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 65}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 66}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 66}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 67}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 67}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 68}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 68}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 69}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 69}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 70}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 70}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 71}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 71}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 72}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 72}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 73}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 73}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 74}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 74}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 75}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 75}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 76}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 76}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 77}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 77}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 78}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 78}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 79}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 79}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 80}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 80}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 81}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 81}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 82}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 82}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 83}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 83}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 84}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 84}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 85}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 85}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 86}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 86}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 87}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 87}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 88}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 88}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 89}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 89}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 90}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 90}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 91}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 91}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 92}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 92}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 93}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 93}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 94}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 94}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 95}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 95}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 96}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 96}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 97}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 97}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 98}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 98}, mean: 0.00000, std: 0.00000, params: {'kernel': 'linear', 'C': 99}, mean: 0.00000, std: 0.00000, params: {'kernel': 'rbf', 'C': 99}]
0.0