python神经网络框架_在深度学习框架下用python写一个简短的三层神经网络预测模型？...

三层神经网络最简实例：

Python 3.6

import numpy as np

def nonlin(x,deriv=False):

if(deriv==True):

return x*(1-x)

return 1/(1+np.exp(-x))

X = np.array([[0,0,1],

[0,1,1],

[1,0,1],

[1,1,1]])

y = np.array([[0],

[1],

[1],

[0]])

np.random.seed(1)

# randomly initialize our weights with mean 0

syn0 = 2*np.random.random((3,4)) - 1

syn1 = 2*np.random.random((4,1)) - 1

for j in xrange(60000):

# Feed forward through layers 0, 1, and 2

l0 = X

l1 = nonlin(np.dot(l0,syn0))

l2 = nonlin(np.dot(l1,syn1))

# how much did we miss the target value?

l2_error = y - l2

if (j% 10000) == 0:

print ("Error:" + str(np.mean(np.abs(l2_error))))

# in what direction is the target value?

# were we really sure? if so, don't change too much.

l2_delta = l2_error*nonlin(l2,deriv=True)

# how much did each l1 value contribute to the l2 error (according to the weights)?

l1_error = l2_delta.dot(syn1.T)

# in what direction is the target l1?

# were we really sure? if so, don't change too much.

l1_delta = l1_error * nonlin(l1,deriv=True)

syn1 += l1.T.dot(l2_delta)

syn0 += l0.T.dot(l1_delta)

变量定义说明X输入数据集，形式为矩阵，每 1 行代表 1 个训练样本。y输出数据集，形式为矩阵，每 1 行代表 1 个训练样本。l0网络第 1 层，即网络输入层。l1网络第 2 层，常称作隐藏层。l2假定为网络最后一层，随着训练进行，其输出应该逐渐接近正确结果syn0第一层权值，突触 0 ，连接 l0 层与 l1 层。syn1第二层权值，突触 1 ，连接 l1 层与 l2 层。l2_error该值说明了神经网络预测时“丢失”的数目。l2_delta该值为经确信度加权后的神经网络的误差，除了确信误差很小时，它近似等于预测误差。l1_error该值为 l2_delta 经 syn1 加权后的结果，从而能够计算得到中间层/隐层的误差。l1_delta该值为经确信度加权后的神经网络 l1 层的误差，除了确信误差很小时，它近似等于 l1_error 。