神经网络基本结构

最新推荐文章于 2024-07-15 22:35:34 发布

171989786

最新推荐文章于 2024-07-15 22:35:34 发布

阅读量1.6k

点赞数

分类专栏：神经网络算法概念文章标签：神经网络算法结构

本文链接：https://blog.csdn.net/u012724704/article/details/60596349

版权

本文探讨了神经网络的基本结构，重点讲解了多层感知器（MLP）和sigmoid神经元。同时，解释了随机梯度下降（SGD）在优化权重和偏置过程中的作用，以及如何通过mini-batch epochs进行高效训练。手写数字识别的例子进一步说明了学习率和训练轮数（epochs）选择的重要性，并提出了如何选择合适的参数以提高模型准确率。

摘要由CSDN通过智能技术生成

MLP(MultiLayer Perceptrons) 多层神经网络 sigmoid neurons

"""
network.py
~~~~~~~~~~

A module to implement the stochastic gradient descent learning
algorithm for a feedforward neural network.  Gradients are calculated
using backpropagation.  Note that I have focused on making the code
simple, easily readable, and easily modifiable.  It is not optimized,
and omits many desirable features.
"""

#### Libraries
# Standard library
import random

# Third-party libraries
import numpy as np

class Network(object):

    def __init__(self, sizes):
        """The list ``sizes`` contains the number of neurons in the
        respective layers of the network.  For example, if the list
        was [2, 3, 1] then it would be a three-layer network, with the
        first layer containing 2 neurons, the second layer 3 neurons,
        and the third layer 1 neuron.  The biases and weights for the
        network are initialized randomly, using a Gaussian
        distribution with mean 0, and variance 1.  Note that the first
        layer is assumed to be an input layer, and by convention we
        won't set any biases for those neurons, since biases are only
        ever used in computing the outputs from later layers."""
        self.num_layers = len(sizes)
        self.sizes = sizes
        self.biases = [np.random.randn(y, 1) for y in sizes[1:]]
        self.weights = [np.random.randn(y, x)
                        for x, y in zip(sizes[:-1], sizes[1:])]

    def feedforward(self, a):
        """Return the output of the network if ``a`` is input."""
        for b, w in zip(self.biases, self.weights):
            a = sigmoid(np.dot(w, a)+b)
        return a

    def SGD(self, training_data, epochs, mini_batch_size, eta,
            test_data=None):
        """Train the neural network using mini-batch stochastic
        gradient descent.  The ``training_data`` is a list of tuples
        ``(x, y)`` representing the training inputs and the desired
        outputs.  The other non-optional parameters are
        self-explanatory.  If ``test_data`` is provided then the
        network will be evaluated against the test data after each
        epoch, and partial progress printed out.  This is useful for
        tracking progress, but slows things down substantially."""
        if test_dat