最近在学习deeplearning的时候接触到了bottle-neck layer,好奇它的作用于是便扒了一些论文(论文链接放在文末吧),系统的了解一下bottle-neck feature究竟有什么用。
论文[1]中对bottle-neck feature的介绍:
对应的图示如下:
直观的理解是这玩意儿应该是用来降维用的,没错,那为什么用它比较好呢,另一篇论文[2]给了解释:
If we do not want to use the dimensionality reduction techniques, and want to obtain the features suitable for the classification as outcome of neural net training process, a bottle-neck has to be created in the neural net structure. The neural net has the ability of nonlinear compression of the input features and of classification of such compressed features. If the trained neural net with bottle-neck h