Maxout Networks

最新推荐文章于 2022-01-16 15:29:09 发布

fourye007

最新推荐文章于 2022-01-16 15:29:09 发布

阅读量419

点赞数

分类专栏： deep-learning 文章标签： maxout network

本文链接：https://blog.csdn.net/yzf0011/article/details/78439037

版权

20 篇文章 0 订阅

订阅专栏

maxout is cross channel pooling
maxout enhances dropout’s abilities as a model averaging technique.
Dropout is generally viewed as an indiscriminately applicable tool that reliably yields a modest improvement in performance when applied to almost any model.

better performance

(Rectifier units do best without cross-channel pooling but with the same number of filters, meaning that the size of the state and the number of parameters must be about k times higher for rectifiers to obtain generalization performance approaching that of maxout.)
The activations of maxout units are not sparse
Model averaging better