多层前馈神经网络有哪些参数_前馈神经网络中的参数数量

多层前馈神经网络有哪些参数

Machine learning is solving such a large number of sophisticated problems today that it seems like magic. But there isn’t any magic in machine learning rather it has a strong mathematical and statistical foundation.

如今，机器学习正在解决如此众多的复杂问题，似乎就像魔术一样。 但是机器学习没有任何魔力，它具有强大的数学和统计基础。

While trying to understand the important and somewhat difficult concepts of machine learning, we sometimes do not even think about some of the trivial concepts. Maybe you think of those, but I know that I ignore a lot of simple things many a times. The reason is the amazing machine learning and deep learning libraries that have functions and methods to quickly do this for us. 😍

在尝试理解机器学习的重要且有些困难的概念时，我们有时甚至没有考虑一些琐碎的概念。 也许您会想到这些，但是我知道我很多次都忽略了许多简单的事情。 原因是令人惊叹的机器学习和深度学习库，它们具有可为我们快速完成此操作的功能和方法。 😍

One such trivial problem is to find the total number of trainable parameters in a feed-forward neural network by hand. A question that I encountered in one of my exams and confused me with the options provided. This question has also been asked in many different forums by many machine learnimg practitioners. 🙋🏻

一个这样的琐碎问题是用手找到前馈神经网络中可训练参数的总数。 我在一项考试中遇到的一个问题，使我对所提供的选项感到困惑。 许多机器学习实践者也在许多不同的论坛中提出了这个问题。 🙋🏻

The problem discussed in this post is:

这篇文章中讨论的问题是：

如何找到前馈神经网络中可训练参数的总数？ (How to find the total number of trainable parameters in a feed-forward neural network?)

You must be wondering why is that even an important one to discuss. It is indeed! The time taken to train a model is dependent on the number of parameters to train so this knowledge can really help us at times.

您一定想知道为什么这甚至是一个重要的话题。 这的确是！ 训练模型所需的时间取决于训练参数的数量，因此这些知识有时确实可以为我们提供帮助。

By looking at a simple network, you can easily count and tell the number of parameters. In the worst case, you can draw the diagram and tell the number of parameters. But what happens when you encounter a question of a neural network with 7 layers and a different number of neurons in each layer, say 8, 10, 12, 15, 15, 12, 6. How would you tell how many parameters are there in all?

通过查看一个简单的网络，您可以轻松地计算并告诉参数数量。 在最坏的情况下，您可以绘制图表并告诉参数数量。 但是，当您遇到一个神经网络的问题，该问题具有7层并且每层中有不同数量的神经元时，比如说8、10、12、15、15、12、6，该怎么办？所有？

Let us together find a mathematical formula to get the count. But before moving to the calculation, let us first understand what a feed-forward neural network is and what characteristics it possesses. This will help us in finding the total number of parameters.

让我们一起找到一个数学公式来获取计数。 但是在进行计算之前，让我们首先了解什么是前馈神经网络以及它具有的特征。 这将帮助我们找到参数的总数。

A feed-forward neural network is the simplest type of artificial neural network where the connections between the perceptrons do not form a cycle.

前馈神经网络是最简单的人工神经网络，其中感知器之间的连接不形成循环。

Despite being the simplest neural network, they are of extreme importance to the machine learning practitioners as they form the basis of many important and advanced applications used today. 🤘

尽管它们是最简单的神经网络，但是它们对于机器学习从业者来说却极为重要，因为它们构成了当今使用的许多重要和高级应用程序的基础。 🤘

Characteristics of a feed-forward neural network:

前馈神经网络的特征：

1. Perceptrons are ar