01 引言
02 监督学习
03 反向传播和链式法则
x的微小变化影响到y的变化,再影响z的变化
In practice, poor local minima are rarely a problem with large net- works. Regardless of the initial conditions, the system nearly always reaches solutions of very similar quality.
前向传递:从前向后的输入
后向传递:从后向前的输入,误差传递的过程(学习过程)
04 卷积神经网络
Many data modalities are in the form of multiple arrays: 1D for signals and sequences, including language; 2D for images or audio spectrograms; and 3D for video or volumetric images.
The first few stages are composed of two types of layers: convolutional layers and pooling layers.
将预处理数据用于卷积运算,加上偏置得到局部特征,卷积核尺度及个数对模型对效果也有一定影响
将卷积输出结果进行非线性激活函数处理,目前常用ReLU
池化操作:取区域的平均值或最大值,保留其显著特征,提升对畸变的容忍能力
Two or three stages of convolution, non-l