What are hyperparameters in machine learning?

In machine learning, we use the term hyperparameter to distinguish from standard model parameters. So, it is worth to first understand what those are.

A machine learning model is the definition of a mathematical formula with a number of parameters that need to be learned from the data. That is the crux of machine learning: fitting a model to the data. This is done through a process known as model training. In other words, by training a model with existing data, we are able to fit the model parameters.

However, there is another kind of parameters that cannot be directly learned from the regular training process. These parameters express “higher-level” properties of the model such as its complexity or how fast it should learn. They are called hyperparameters. Hyperparameters are usually fixed before the actual training process begins.

So, how are hyperparameters decided? That is probably beyond the scope of this question, but suffice to say that, broadly speaking, this is done by setting different values for those hyperparameters, training different models, and deciding which ones work best by testing them.

So, to summarize. Hyperparameters:

  • Define higher level concepts about the model such as complexity, or capacity to learn.
  • Cannot be learned directly from the data in the standard model training process and need to be predefined.
  • Can be decided by setting different values, training different models, and choosing the values that test better

Some examples of hyperparameters:

  • Number of leaves or depth of a tree
  • Number of latent factors in a matrix factorization
  • Learning rate (in many models)
  • Number of hidden layers in a deep neural network
  • Number of clusters in a k-means clustering

转载于:https://my.oschina.net/u/1757446/blog/735383

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值