轻 量 化 网 络 轻量化网络 轻量化网络
模型压缩与蒸馏模型
网络结构设计:
模型压缩:
1.知识蒸馏:
2.剪枝
- Learning both Weights and Connections for Efficient Neural Networks
- Deep Compression
- Networks Slimming
- Pruning for Resource Efficient Transfer Learning
- Pruning from Search
- Transformable Architecture Search
3.量化
4.低秩分解