多隐层神经网络

最新推荐文章于 2024-07-05 13:45:41 发布

砰！

最新推荐文章于 2024-07-05 13:45:41 发布

阅读量885

点赞数

分类专栏：吴恩达深度学习课程文章标签：神经网络深度学习 python

本文链接：https://blog.csdn.net/Harder_14/article/details/108327499

版权

本文详细介绍了构建多隐层神经网络的过程，从定义网络结构和初始化参数开始，接着阐述了前向运算的流程，然后重点讨论了损失函数及其在后向运算中的作用。最后，总结了模型参数更新的整体步骤。

摘要由CSDN通过智能技术生成

多隐层神经网络步骤：

1.定义网络结构，初始化，包括参数和隐藏层数和单元数

  
def initialize_parameters_deep(layer_dims):
    """
    Arguments:
    layer_dims -- python array (list) containing the dimensions of each layer in our network
    
    Returns:
    parameters -- python dictionary containing your parameters "W1", "b1", ..., "WL", "bL":
                    Wl -- weight matrix of shape (layer_dims[l], layer_dims[l-1])
                    bl -- bias vector of shape (layer_dims[l], 1)
    """
    
    np.random.seed(3)
    parameters = {}
    L = len(layer_dims)            # number of layers in the network

    for l in range(1, L):
        ### START CODE HERE ### (≈ 2 lines of code)
        parameters['W' + str(l)] = np.random.randn(layer_dims[l],layer_dims[l-1])*0.01
        parameters['b' + str(l)] = np.zeros((layer_dims[l],1))
        ### END CODE HERE ###
        
        assert(parameters['W' + str(l)].shape == (layer_dims[l], layer_dims[l-1]))
        assert(parameters['b' + str(l)].shape == (layer_dims[l], 1))

        
    return parameters

2.前向运算


def linear_forward(A, W, b):
    """
    Implement the linear part of a layer's forward propagation.

    Arguments:
    A -- activations from previous layer (or input data): (size of previous layer, number of examples)
    W -- weights matrix: numpy array of shape (size of current layer, size of previous layer)
    b -- bias vector, numpy array of shape (size of the current layer, 1)

    Returns:
    Z -- the input of the activation function, also called pre-activation parameter 
    cache -- a python tuple containing "A", "W" and "b" ; stored for computing the backward pass efficiently
    """   
    ### START CODE HERE ### (≈ 1 line of code)
    Z = np.dot(W,A)+b
    ### END CODE HERE ###   
    assert(Z.shape