论文自我理解

最新推荐文章于 2024-03-28 21:54:45 发布

diamondkingp

最新推荐文章于 2024-03-28 21:54:45 发布

阅读量130

点赞数

分类专栏：论文简述文章标签：深度学习通道剪枝

本文链接：https://blog.csdn.net/diamondkingp/article/details/99301185

版权

论文简述专栏收录该内容

1 篇文章 0 订阅

订阅专栏

Optimal Brain Damage 1989
This paper is the ground breaking work of network pruning of Model Compression.
From this paper, I know the procedure of OBD :
(1). Choose the reasonable network architecture
(2). Train the network until a good solution is obtained
(3): Compute the second derivative hkk for each parameter
(4): Compute the saliencies for each parameters: sk = hkk uk2/2
(5): Iterate to step 2

A new technique called OBD for reducing the size of a learning network seletively deleting weights.
Networks with too many weights do not generalize well. However, networks with too few weights will not have enough power to represent the data accurately.
One technique to reach this tradeoff is to minimize the cost function composed of two terms:

在这里插入图片描述