1、AFF:注意力特征融合
https://mp.weixin.qq.com/s/xttOO1FG0X-3nu-rCQUhhw
2、模型蒸馏(大模型蒸馏小模型)
如:MEAL V2 https://mp.weixin.qq.com/s/Mtiz3apeAVRE-0x5f-kQwQ
3、acnet,新的卷积
https://zhuanlan.zhihu.com/p/131282789
4、HSB channel层多层split再组合
https://mp.weixin.qq.com/s/Q0Qg4AABUSOC_X9pzkvaQw
5、语义角度的数据增强
https://mp.weixin.qq.com/s/zIRfYh8db4hw85cAXcOJHQ
6、LambdaNetworks: Modeling long-range Interactions without Attention