What is transfer learning? You can take a pretrained network and use it as a starting point to learn a new task. Transfer learning only works in deep learning if the model features learned from the first task are general.