Life Long Learning(LLL) 终身学习(增量学习)(Continuous Learning & Incremental Learning)

什么是lifelong learning

人在学习的时候,只有一个大脑,从初中到高中到大学,都是用同一个大脑在学习的

然而在机器学习当中,机器学习的情形真的和人很不一样

机器学习对于每一个作业都会训练一个不同的模型吗,例如从作业1到作业3会训练3个不同的模型

那么为什么我们不每一次作业都训练同一个模型呢

使用同一个模型来进行学习,就是life long learning

Life Long Learning, 也叫Continuous Learning, Never Ending Learning, Incremental Learning

Life Long learning的过程

要让机器能够做到 life long learning, 我们至少需要解决三个问题

①Knowledge Retention 知识保留

    让机器把它学过的机器记下来

    不能忘记旧的,也要能学新的

     如果只使用一个模型来不断的学习不同的任务,自然希望它在学习新的任务的时候,也不要忘记已经学习到的东西。与multi-task learning不太一样——稳定性

②Knowledge Transfer 知识迁移

       我们希望我们的模型可以使用已经学习到的东西来帮助解决新的问题,达到触类旁通的效果。与transfer learning又不太一样——可塑性

③Model Expansion 模型拓展

      如果模型比较简单,也许处理简单问题时还可以,但是在处理复杂问题时结果不太满意。故我们希望模型可以自己根据问题的复杂度进行扩展,变为更加复杂的模型

知识迁移流程:

  • 1.任务按顺序接收
  • 2.从先前学习的任务中迁移知识
  • 3.存储新知识以备将使用
  • 4.改善现有知识

在这里插入图片描述

Multi-task learning,Transfer learning,LifeLong learning之间的区别

Transfer Learning vs LifeLong Learning
Transfer learning只考虑在当前任务上的效果
而LifeLong Learning需要考虑在所有任务上的效果

Multi-task Learning VS LifeLong Learning
LifeLong Learning训练时只用当前任务的数据
Multi-task Learning会用到之前所有任务的数据

这带来了数据存储以及计算量不断增大的问题; Multi-task learning可以看作是LifeLong learning的upper bound

李宏毅——终身学习lifelong learning_shaoyue1234的博客-CSDN博客

李宏毅2020机器学习深度学习(完整版)国语_哔哩哔哩_bilibili

  • 1
    点赞
  • 5
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
Lifelong Machine Learning (Synthesis Lectures on Artificial Intelligence and Machine Learning) By 作者: Zhiyuan Chen – Bing Liu ISBN-10 书号: 1681733021 ISBN-13 书号:: 9781681733029 Edition 版本: 2 Release Finelybook 出版日期: 2018-08-14 pages 页数: (207 ) $79.95 Book Description to Finelybook sorting Synthesis Lectures on Artificial Intelligence and Machine Learning Lifelong Machine Learning, Second Edition 版本 is an introduction to an advanced machine learning paradigm that continuously learns by accumulating past knowledge that it then uses in future learning and problem solving. In contrast, the current dominant machine learning paradigm learns in isolation: given a training dataset, it runs a machine learning algorithm on the dataset to produce a model that is then used in its intended application. It makes no attempt to retain the learned knowledge and use it in subsequent learning. Unlike this isolated system, humans learn effectively with only a few examples precisely because our learning is very knowledge-driven: the knowledge learned in the past helps us learn new things with little data or effort. Lifelong learning aims to emulate this capability, because without it, an AI system cannot be considered truly intelligent. Research in lifelong learning has developed significantly in the relatively short time since the first edition of this book was published. The purpose of this second edition is to expand the definition of lifelong learning, update the content of several chapters, and add a new chapter about continual learning in deep neural networks—which has been actively researched over the past two or three years. A few chapters have also been reorganized to make each of them more coherent for the reader. Moreover, the authors want to propose a unified framework for the research area. Currently, there are several research topics in machine learning that are closely related to lifelong learning—most notably, multi-task learning, transfer learning, and meta-learning—because they also employ the idea of knowledge sharing and transfer. This book brings all these topics under one roof and discusses their similarities and differences. Its goal is to introduce this emerging machine learning paradigm and present a comprehensive survey and review of the important research results and latest ideas in the area. This book is thus suitable for students, researchers, and practitioners who are interested in machine learning, data mining, natural language processing, or pattern recognition. Lecturers can readily use the book for courses in any of these related fields. Preface Acknowledgments Introduction Related Learning Paradigms Lifelong Supervised Learning Continual Learning and Catastrophic Forgetting Open-World Learning Lifelong Topic Modeling Lifelong Information Extraction Continuous Knowledge Learning in Chatbots Lifelong Reinforcement Learning Conclusion and Future Directions Bibliography Authors’Biographies Blank Page

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值