Transfer Learning with CNNs
- Train on ImageNet
- fine-tuning with small dataset
retrain only the classifier
swap the Softmax layer at the layer - fine-tuning with medium dataset
use the old weights as initialization, train the full network or only some of higher layers