Introduction
the motivation is online continual learning with a fixed architecture by modeling the task-specific features.
Contextual transformation network (a base network and a controller)
什么是episodic memory? Episodic memory是用于base model的训练
什么是semantic memory? Semantic memory适用于controller的训练
利用神经科学的解释(complementary learning system, CLS理论)?
Neocortex learn the structured knowledge
Hippocampus 快速学习
Contextual transformation体现在哪里?
Method
Feature-wise transformation, efficiently extract the task-specific features from the common features;
Given the task-identifier t, 利用controller生成变换参数;
The controller的目的?得到变换矩阵,the task-specific features can generalize to both previous and current tasks, while simultaneously
Key points
代码开源链接