三层神经网络

python代码

import numpy as np

def nonlin(x,deriv=False):
    if(deriv==True):
         return x*(1-x)

    return 1/(1+np.exp(-x))
    
X = np.array([[0,0,1],[0,1,1],[1,0,1],[1,1,1]])
                
y = np.array([[0],[1],[1],[0]])

np.random.seed(1)

# randomly initialize our weights with mean 0
syn0 = 2*np.random.random((3,4)) - 1   #第一层权值
syn1 = 2*np.random.random((4,1)) - 1   #第二层权值

for j in range(60000):

    # Feed forward through layers 0, 1, and 2
    l0 = X                         #输入层
    l1 = nonlin(np.dot(l0,syn0))   #隐藏层
    l2 = nonlin(np.dot(l1,syn1))   #输出层

    # how much did we miss the target value?
    l2_error = y - l2
    
    if (j% 10000) == 0:
        print ("Error:" + str(np.mean(np.abs(l2_error))))       
    # in what direction is the target value?
    # were we really sure? if so, don't change too much.
    l2_delta = l2_error*nonlin(l2,deriv=True)   #基于置信度衡量的输出误差,即当斜率很平缓时,结果是很让人相信的

    # how much did each l1 value contribute to the l2 error (according to the weights)?
    l1_error = l2_delta.dot(syn1.T)            #l2_delta误差是由syn1的权值决定的,故可计算隐藏层误差
    
    # in what direction is the target l1?
    # were we really sure? if so, don't change too much.
    l1_delta = l1_error * nonlin(l1,deriv=True)

    syn1 += l1.T.dot(l2_delta)
    syn0 += l0.T.dot(l1_delta)
    
#Test the network we have trained 
test_X=np.array([[1,0,1]])
l1 = nonlin(np.dot(test_X,syn0))
l2 = nonlin(np.dot(l1,syn1))
print (l1)
print (l2)

输出结果

Error:0.496410031903
Error:0.00858452565325
Error:0.00578945986251
Error:0.00462917677677
Error:0.00395876528027
Error:0.00351012256786
[[ 0.9962294   0.89521133  0.02231202  0.83838578]]
[[ 0.99701713]]




  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值