Edible Instruction
More Mathematics knowledges, pls refer to https://blog.csdn.net/landian0531/article/details/118145417
- Too many formulations and equations, so screen shots of PPT is necessary.
- My mathematics sucks, so you 'll see many mathematical knowledge interspersed in my all ML learning session.
- Don’t be afraid of any mathematical symbol, just BAIDU the definition.
New Optimizers for Deep Learning
Some Notations:
SGD
SGD with Momentum (SGDM)
Agagrad
RMSProp
Adm
Convergence(收敛)