梯度检查

最新推荐文章于 2023-06-16 15:22:05 发布

砰！

最新推荐文章于 2023-06-16 15:22:05 发布

阅读量300

点赞数 1

分类专栏：吴恩达深度学习课程文章标签： python 机器学习深度学习

本文链接：https://blog.csdn.net/Harder_14/article/details/108533649

版权

本文介绍了在Python环境中，如何进行1维和N维梯度检查，这是深度学习和机器学习中验证模型优化过程的重要步骤。

摘要由CSDN通过智能技术生成

1.导入包

import numpy as np
from testCases import *
from gc_utils import sigmoid, relu, dictionary_to_vector, vector_to_dictionary, gradients_to_vector

2.1维梯度检查

def forward_propagation(x, theta):
    """
    Implement the linear forward propagation (compute J) presented in Figure 1 (J(theta) = theta * x)
    
    Arguments:
    x -- a real-valued input
    theta -- our parameter, a real number as well
    
    Returns:
    J -- the value of function J, computed using the formula J(theta) = theta * x
    """
    
    ### START CODE HERE ### (approx. 1 line)
    J = theta *x
    ### END CODE HERE ###
    
    return J



def backward_propagation(x, theta):
    """
    Computes the derivative of J with respect to theta (see Figure 1).
    
    Arguments:
    x -- a real-valued input
    theta -- our parameter, a real number as well
    
    Returns:
    dtheta -- the gradient of the cost with respect to theta
    """
    
    ### START CODE HERE ### (approx. 1 line)
    dtheta = x
    ### END CODE HERE ###
    
    return dtheta


def gradient_check(x, theta, epsilon = 1e-7):
    """
    Implement the backward propagation presented in Figure 1.
    
    Arguments:
    x -- a real-valued input
    theta -- our parameter, a real number as well
    epsilon -- tiny shift to the input to compute approximated gradient with formula(1)
    
    Returns:
    difference -- difference (2) between the approximated gradient and the backward propagation gradient
    """
    
    # Compute gradapprox using left side of formula (1). eps