ICLR2021-Contextual Transformation Networks for Online Continual Learning

Introduction

the motivation is online continual learning with a fixed architecture by modeling the task-specific features.
Contextual transformation network (a base network and a controller)
什么是episodic memory? Episodic memory是用于base model的训练
什么是semantic memory? Semantic memory适用于controller的训练
利用神经科学的解释（complementary learning system, CLS理论）？
Neocortex learn the structured knowledge
Hippocampus 快速学习
Contextual transformation体现在哪里？

Method

Feature-wise transformation, efficiently extract the task-specific features from the common features;
Given the task-identifier t, 利用controller生成变换参数；
The controller的目的？得到变换矩阵，the task-specific features can generalize to both previous and current tasks, while simultaneously

Key points

代码开源链接