![](https://img-blog.csdnimg.cn/20201014180756928.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
Deep Learning
issory
这个作者很懒,什么都没留下…
展开
-
C5eg1 Linear Regression
Gold To build a system that can take a vector x⃗∈Rn\vec{x}\in\mathbb{R}^nx∈Rn as input and predict the value of a scalar y∈Ry\in\mathbb{R}y∈R as its output. Definition Output:y^=w⃗Tx⃗\hat{y}=\vec{w...原创 2018-10-20 19:11:15 · 136 阅读 · 0 评论 -
C4eg1-Linear Least Squares
Suppose f(x)=12∥Ax−b∥22f(x)=\frac{1}{2}\|Ax-b\|_2^2f(x)=21∥Ax−b∥22 gradient-based optimization obtain the gradient: ∇xf(x)=AT(Ax−b)=ATAx−ATb\nabla_xf(x)=A^T(Ax-b)=A^TAx-A^Tb∇xf(x)=AT(Ax−b)=ATAx−A...原创 2018-10-20 19:08:20 · 107 阅读 · 0 评论 -
C4-Numerical Computation
Overflow and Underflow underflow occurs when numbers near zero are rounded to zero Overflow occurs when numbers with large magnitude are approximated as ∞\infty∞ or −∞-\infty−∞ Softmax function...原创 2018-10-20 19:08:01 · 208 阅读 · 0 评论 -
C3-Probability and Information Theory
Possible sources of uncertainty Inherent stochasticity in the system being modeled. Incomplete observability. Incomplete modeling. Concepts Note: In this note, x\text{x}x is random varaible and xxx ...原创 2018-10-20 19:06:56 · 174 阅读 · 0 评论 -
C2-Linear Algebra
concepts linear algebra is a form of continuous rather than discrete mathematics detailed information --> Matrix Cookbook (Petersen and Pedersen, 2006) Scalars:–>(ponit) A scalar is just a sin...原创 2018-10-20 19:04:08 · 153 阅读 · 0 评论 -
C1-Introduction
Some Concepts The hierarcy of concepts allows the computer to learn complicated concepts by building them out of simpler ones. --> deep learning A computer can reason about statements in these fo...原创 2018-10-20 18:12:58 · 279 阅读 · 0 评论 -
C2eg1-Principal Components Analysis
Suppose mmm points {x(1),⋯ ,x(m)}∈Rn\{\mathbf{x}^{(1)},\cdots,\mathbf{x}^{(m)}\} \in \mathbb{R}^n{x(1),⋯,x(m)}∈Rn each point x(i)∈Rn\mathbf{x}^{(i)}\in \mathbb{R}^nx(i)∈Rn corresponding...原创 2018-10-20 18:12:17 · 78 阅读 · 0 评论