【Distill 系列：二】CVPR 2019 Distilling Object Detectors with Fine-grained Feature Imitation

cvpr 2019

detectors care more about local near object regions

motivation

• Fitnets: Hints for thin deep nets

  hint learning 利用网络中间层 teacher & student feature map L2 loss
  分析 feature map 整体做 hint 不好，detectors care more about local regions that overlap with ground truth objects while classification models pay more attention to global context.

本文并不是对整个feature map 做的 hint learning，而是只对 gt附近的anchor 进行蒸馏，有一个 fine-grained feature limitation

红框：和 gt box IOU 最大
绿框：与 gt box IOU 大于 下限阈值

method

• 对于每个 gt box，我们计算它与所有锚点之间的IOU，从而形成 W×H×K IOU map m
  (W和H表示 feature map 的宽度和高度，K表示K个预设锚框)
• 然后我们找到最大的IOU值 M = ma