论文笔记
LetheSec
这个作者很懒,什么都没留下…
展开
-
【论文笔记——AMDIM】Learning Representations by Maximizing Mutual Information Across Views
arxiv:https://arxiv.org/abs/1906.00910code:https://github.com/Philip-Bachman/amdim-public1 Introduction这篇文章是对 DIM 进行的一个扩展研究(主要是Local DIM),主要是在 DIM 的基础上引入了 mutiple views ,也就是最大化一个共享 context 中不同视图(views)之间互信息(Across Views)。什么是 mutiple views 呢?例如,我们观察一个事原创 2020-11-21 17:29:37 · 3975 阅读 · 3 评论 -
【论文笔记——DIM】Learning Deep Representations By Mutual Information Estimation and Maximization
arxiv:https://arxiv.org/abs/1808.06670code:https://github.com/rdevon/DIMreport video:https://www.youtube.com/watch?v=o1HIkn8LEsw&t=256s1 Introduction无监督学习一个重要的问题就是学习有用的 representation,本文的目的就是训练一个 representation learning 函数(即编码器encoder) ,其通过最大编码器输入和原创 2020-11-07 15:43:57 · 4392 阅读 · 4 评论 -
【论文笔记——对比预测编码CPC】Representation Learning with Contrastive Predictive Coding
Representation Learning with Contrastive Predictive Coding论文链接:https://arxiv.org/abs/1807.037481 Introduce作者提出了一种叫做“对比预测编码(CPC, Contrastive Predictive Coding)”的无监督方法,可以从高维数据中提取有用的 representation,这种 representation 学习到了对预测未来最有用的信息。目前无监督学习存在的问题:如何更好的从原原创 2020-10-19 00:53:16 · 5097 阅读 · 4 评论 -
【论文笔记——自监督学习综述】Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey
【论文笔记——自监督学习综述】Self-supervised Visual Feature Learning with Deep Neural Networks: A SurveyAbstractLarge-scale labeled data are generally required to train deep neural networks in order to obtain better performance in visual feature learning from images原创 2020-10-11 14:22:05 · 7001 阅读 · 1 评论