使用GridSearchCV和RandomizedSearchCV进行超参数调整

In Machine Learning, a hyperparameter is a parameter whose value is used to control the learning process.

在机器学习中， 超参数是一个参数，其值用于控制学习过程。

Hyperparameters can be classified as model hyperparameters, which cannot be inferred while fitting the machine to the training set because they refer to the model selection task, or algorithm hyperparameters, that in principle have no influence on the performance of the model but affect the speed and quality of the learning process. An example of a model hyperparameter is the topology and size of a neural network. Examples of algorithm hyperparameters are learning rate and mini-batch size.

可以将超参数归类为模型超参数，它们无法在将机器安装到训练集上时进行推断，因为它们是指模型选择任务或算法超参数，它们原则上不会影响模型的性能，但会影响速度和学习过程的质量。 模型超参数的一个示例是神经网络的拓扑和大小。 算法超参数的示例是学习率和小批量大小。

Different model training algorithms require different hyperparameters, some simple algorithms (such as ordinary least squares regression) require none. Given these hyperparameters, the training algorithm learns the parameters from the data. For instance, LASSO is an algorithm that adds a regularization hyperparameter to ordinary least squares regression, which has to be set before estimating the parameters through the training algorithm.

不同的模型训练算法需要不同的超参数，一些简单的算法(例如普通最小二乘回归)则不需要。 给定这些超参数，训练算法会从数据中学习参数。 例如，LASSO是一种将常规化超参数添加到普通最小二乘回归的算法，必须在通过训练算法估算参数之前进行设置。

A model hyperparameter is a configuration that is external to the model and whose value cannot be estimated from data.

模型超参数是模型外部的配置，无法从数据中估计其值。

• They are often used in processes to help estimate model parameters.
  它们通常用于流程中以帮助估计模型参数。
• They are often specified by the practitioner.
  它们通常由从业者指定。
• They can often be set using heuristics.
  通常可以使用试探法来设置它们。
• They are often tuned for a given predictive modeling problem.
  它们通常针对给定的预测建模问题进行调整。

We cannot know the best value for a model hyperparameter on a given problem. We may use rules of thumb, copy values used on other problems, or search for the best value by trial and error.

我们无法确定给定问题上模型超参数的最佳值。 我们可能会使用经验法则，复制在其他问题上使用的值，或者通过反复试验寻找最佳值。

When a machine learning algorithm is tuned for a specific problem, such as when you are using a grid search or a random search, then you are tuning the hyperparameters of the model or order to discover the parameters of the model that result in the most skilful predictions.

当针对特定问题调整了机器学习算法时(例如，当您使用网格搜索或随机搜索时)，则您正在调整模型的超参数或为了发现导致最熟练的模型参数而进行调整。预测。

Here we are going to