链式法则
Derivative Rules
| Rules | Function | Derivative |
|---|---|---|
| sum | f + g f+g f+g | f ′ + g ′ f^{'}+g^{'} f′+g′ |
| difference | f − g f-g f−g | f ′ − g ′ f^{'}-g^{'} f′−g′ |
| product | f g fg fg | f g ′ + f ′ g fg^{'}+f^{'}g fg′+f′g |
| quotient | f / g f/g f/g | ( f g ′ + f ′ g ) / g 2 (fg^{'}+f^{'}g)/g^{2} (fg′+f′g)/g2 |
| chain(using d d x \frac{d}{dx} dxd) | d y d x = d y d u d u d x \frac{dy}{dx}=\frac{dy}{du}\frac{du}{dx} dxdy=dudydxdu |
Chain rule
∂
y
∂
x
=
∂
y
∂
u
∂
u
∂
x
\frac{\partial y}{\partial x}=\frac{\partial y}{\partial u}\frac{\partial u}{\partial x}
∂x∂y=∂u∂y∂x∂u
y
1
=
x
w
1
+
b
1
y_{1}=xw_{1}+b_{1}
y1=xw1+b1
y
2
=
y
1
w
2
+
b
2
y_{2}=y_{1}w_{2}+b_{2}
y2=y1w2+b2
y
1
y_{1}
y1为中间变量
∂
y
2
∂
w
1
=
∂
f
(
y
1
)
∂
w
1
=
∂
f
(
y
1
)
∂
y
1
∂
y
1
∂
w
1
=
w
2
∗
x
\frac{\partial y_{2}}{\partial w_{1}}=\frac{\partial f(y_{1})}{\partial w_{1}}=\frac{\partial f(y_{1})}{\partial y_{1}}\frac{\partial y_{1}}{\partial w_{1}}=w_{2}*x
∂w1∂y2=∂w1∂f(y1)=∂y1∂f(y1)∂w1∂y1=w2∗x
从复杂到简单。
扫一扫
259
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
