Multi-Task Learning的几篇综述文章

下面分别介绍多任务学习（MTL）的三篇综述文章。

Ruder S, “An Overview of Multi-Task Learning in Deep Neural Networks”, arXiv 1706.05098, June 2017

深度学习方面MTL总结：
按照隐层，MTL基本分两类：Hard sharing 和 Soft sharing

Hard sharing在多任务之间共享隐层，降低over fitting的风险。“The more tasks we are learning simultaneously, the more our model has to find a representation that captures all of the tasks and the less is our chance of overfitting on our original task”

Soft sharing各任务之间有自己的模型和参数，主要靠regularization鼓励任务之间的模型参数相似。

MTL的机制有几点：
· Implicit data augmentation 数据增强
· Attention focusing 注意
· Eavesdropping 窃听
· Representation bias 表示偏向
· Regularization 正则化

非神经网络模型中的MTL，主要有两种：
· Block-sparse regularization：enforcing sparsity across tasks through norm regularization
· Learning task relationships：m