批量梯度下降（Batch Gradient Descent）、随机梯度下降（Stochastic Gradient Descent）和小批量梯度下降（Mini-batch Gradient Descent）是优化机器学习算法的策略。SGD每次使用一个样本更新参数，而BGD则使用所有样本。小批量GD在二者间平衡，常用批大小为32、64和128。学习曲线有助于评估模型的过拟合和欠拟合。
gradient descent
- Stochastic Gradient Descent, or SGD for short, is an optimization algorithm used to train machine learning algorithms；The job of the algorithm is to find a set of internal model parameters that perform well against some performance measure such as logarithmic loss or mean squared error.
- The optimization algorithm is called “gradient descent“, where “gradient” refers to the calculation of an error gradient or slope of error and “descent” refers to the moving down along that slope towards some minimum level of error
- The algorithm is iterative. This means that the search process occurs over multiple discrete steps, each step hopefully slightly improving the model parameters。
- Each step involves using the model with the current set of internal parameters to make predictions on some samples, comparing the predictions to the real expected outcomes
最低0.47元/天 解锁文章
1103
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
