Deep Learning从入门到出世(二)

二. 深度网络:现代实践

这一部分是炼丹师需要掌握的核心知识,介绍了深度前馈网络,卷积网络, 循环和递归网络,实践性很强的调参技巧如深度学习的正则化,深度模型中的优化方法等等。对于长时间耕耘炼丹这一领域,是需要反复研读实践的。每个点都是可以深入坑。

1. 深度学习的模型

  • 前馈网络
  • 卷积网络
  • 循环网络
  • 递归网络
  • 生成对抗网络

2. 深度学习的正则化

  • L 1 L^1 L1 L 2 L^2 L2范数的正则化
  • 数据集增强
  • 注入噪声
  • 提前终止
  • 参数绑定和参数共享
  • 稀疏表示
  • Dropout

3. 深度学习的优化

  • SGD
  • 带动量的SGD
  • Adam
  • 牛顿法
  • 共轭梯度
  • BFGS
- [1] Pattern Recognition and Mechine Learning. Christopher M.Bishop. Spring 2006.
- [2] Deep Learning. Ian Goodfellow. MIT Press 2016
- [3] Numerical Optimization.Jorge Nocedal and Stephen J.Wright.Springer 1999.
- [4] Convex Optimization. Stephen Boyd. Cambridge University Press 2004.
- [5] Machine Learning in Action. Peter Harrington. 2013.
  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
Deep Learning, Vol. 1: From Basics to Practice By 作者: Andrew Glassner Pub Date: 2018 ISBN: n/a Pages: (909 of 1750) Language: English Format: PDF People are using the tools of deep learning to change how we think about science, art, engineering, business, medicine, and even music. This book is for people who want to understand this field well enough to create deep learning systems, train them, and then use them with confidence to make their own contributions. The book takes a friendly, informal approach. Our goal is to make the ideas of this field simple and accessible to everyone, as shown in the Contents below. Since most practitioners today use one of several free, open-source deep-learning libraries to build their systems, the hard part isn’t in the programming. Rather, it’s knowing what tools to use, and when, and how. Building a working deep learning system requires making a series of technically informed choices, and with today’s tools, those choices require understanding what’s going on under the hood. This book is designed to give you that understanding. You’ll be able to choose the right kind of architecture, how to build a system that can learn, how to train it, and then how to use it to accomplish your goals. You’ll be able to read and understand the documentation for whatever library you’d like to use. And you’ll be able to follow exciting, on-going breakthroughs as they appear, because you’ll have the knowledge and vocabulary that let you read new material, and discuss it with other people doing deep learning. The book is extensively illustrated with over 1000 original figures. They are also all available for free download, for your own use. You don’t need any previous experience with machine learning or deep learning for this book. You don’t need to be a mathematician, because there’s nothing in the book harder than the occasional multiplication. You don’t need to choose a particular programming language, or library, or piece of hardware, because our approach is largely independent of those things. Our focus is on the principles and techniques that are applicable to any language, library, and hardware. Even so, practical programming is important. To stay focused, we gather our programming discussions into 3 chapters that show how to use two important and free Python libraries. Both chapters come with extensive Jupyter notebooks that contain all the code. Other chapters also offer notebooks for for every Python-generated figure. Our goal is to give you all the basics you need to understand deep learning, and then show how to use those ideas to construct your own systems. Everything is covered from the ground up, culminating in working systems illustrated with running code. The book is organized into two volumes. Volume 1 covers the basic ideas that support the field, and which form the core understanding for using these methods well. Volume 2 puts these principles into practice. Deep learning is fast becoming part of the intellectual toolkit used by scientists, artists, executives, doctors, musicians, and anyone else who wants to discover the information hiding in their data, paintings, business reports, test results, musical scores, and more.

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值