3层神经网络简单实现——代码小结

权重和偏置的初始化

保存了每一层所需的参数（权重和偏置），并将其保存在字典变量network里

权重：控制输入信号的重要性参数
偏置：调整神经元被激活的难易程度

def init_network():
    network = {}
    network['W1'] = np.array([[0.1,0.3,0.5],[0.2,0.4,0.6]])
    network['b1'] = np.array([0.1,0.2,0.3])
    network['W2'] = np.array([[0.1,0.4],[0.2,0.5],[0.3,0.6]])
    network['b2'] = np.array([0.1,0.2])
    network['W3'] = np.array([[0.1,0.3],[0.2,0.4]])
    network['b3'] = np.array([0.1,0.2])
    return network

信号处理过程

前向处理：从输入到输出方向的传递处理

# 前向处理，从输入到输出方向的传递处理
def forward(network,x):
    W1,W2,W3 = network['W1'],network['W2'],network['W3']
    b1,b2,b3 = network['b1'],network['b2'],network['b3']
    
    a1 = np.dot(x,W1)+b1
    z1 = sigmoid(a1)
    a2 = np.dot(z1,W2)+b2
    z2 = sigmoid(a2)
    a3 = np.dot(z2,W3)+b3
    y = identity_function(a3)
    
    return y

## 输出层激活函数
def identity_function(x):
    return x
network = init_network()
x = np.array([1.0,0.5])
y = forward(network,x)
print(y)#[0.31682708 0.69627909]