多层神经网络前向及后向传播的公式总结

1、初始化参数：

# layer_dims -- python array (list) containing the dimensions of each layer in our network

# parameters -- python dictionary containing your parameters "W1", "b1", ..., "WL", "bL"

parameters = {}

L = len(layer_dims)  # number of layers in the network

	for l in range(1, L):
	        parameters['W' + str(l)] = np.random.randn(layer_dims[l], layer_dims[l-1]) * 0.01
       		parameters['b' + str(l)] = np.zeros((layer_dims[l], 1))

2、线性前向传播：

# A -- activations from previous layer (or input data): (size of previous layer, number of examples)
# W -- weights matrix: numpy array of shape (size of current layer, size of previous layer)
# b -- bias vector, numpy array of shape (size of the current layer, 1)
Z = np.dot(W.T, A) + b

3、激活函数

# A_prev -- activations from previous layer (or input data): (size of previous layer, number of examples)