三层神经网络最简实例:
Python 3.6
import numpy as np
def nonlin(x,deriv=False):
if(deriv==True):
return x*(1-x)
return 1/(1+np.exp(-x))
X = np.array([[0,0,1],
[0,1,1],
[1,0,1],
[1,1,1]])
y = np.array([[0],
[1],
[1],
[0]])
np.random.seed(1)
# randomly initialize our weights with mean 0
syn0 = 2*np.random.random((3,4)) - 1
syn1 = 2*np.random.random((4,1)) - 1
for j in xrange(60000):
# Feed forward through layers 0, 1, and 2
l0 = X
l1 = nonlin(np.dot(l0,syn0))
l2 = nonlin(np.dot(l1,syn1))
# how much did we miss the target value?
l2_error = y - l2
if (j% 10000) == 0:
print ("Error:" + str(np.mean(np.abs(l2_error))))
# in what direction is the target value?
# were we really sure? if so, don't change too much.
l2_delta = l2_error*nonlin(l2,deriv=True)
# how much did each l1 value contribute to the l2 error (according to the weights)?
l1_error = l2_delta.dot(syn1.T)
# in what direction is the target l1?
# were we really sure? if so, don't change too much.
l1_delta = l1_error * nonlin(l1,deriv=True)
syn1 += l1.T.dot(l2_delta)
syn0 += l0.T.dot(l1_delta)
变量定义说明X输入数据集,形式为矩阵,每 1 行代表 1 个训练样本。y输出数据集,形式为矩阵,每 1 行代表 1 个训练样本。l0网络第 1 层,即网络输入层。l1网络第 2 层,常称作隐藏层。l2假定为网络最后一层,随着训练进行,其输出应该逐渐接近正确结果syn0第一层权值,突触 0 ,连接 l0 层与 l1 层。syn1第二层权值,突触 1 ,连接 l1 层与 l2 层。l2_error该值说明了神经网络预测时“丢失”的数目。l2_delta该值为经确信度加权后的神经网络的误差,除了确信误差很小时,它近似等于预测误差。l1_error该值为 l2_delta 经 syn1 加权后的结果,从而能够计算得到中间层/隐层的误差。l1_delta该值为经确信度加权后的神经网络 l1 层的误差,除了确信误差很小时,它近似等于 l1_error 。