知识准备:
( l o g x ) ′ = 1 / x (logx)^\prime = 1/x (logx)′=1/x
Power rule:
d d x x n = lim h → 0 ( x + h ) n − x n h \frac{d}{dx}\ x^n = \lim_{h→0}\ \frac{(x+h)^n - x^n}{h}\ dxd xn=h→0lim h(x+h)n−xn
d d x x n = lim h → 0 x n + n x n − 1 h + h h h − x n h \frac{d}{dx}\ x^n = \lim_{h→0}\ \frac{x^n + nx^{n-1}h + hhh - x^n}{h}\ dxd xn=h→0lim hxn+nxn−1h+hhh−xn
d d x x n = lim h → 0 n x n − 1 h − h h h h \frac{d}{dx}\ x^n= \lim_{h→0}\ \frac{nx^{n-1}h - hhh}{h}\ dxd xn=h→0lim hnxn−1h−hhh
d d x x n = n x n − 1 \frac{d}{dx}\ x^n= nx^{n-1} dxd xn=nxn−1
Product rule:
f ( x ) > 0 g ( x ) > 0 f(x)>0 \quad g(x)>0 f(x)>0g(x)>0
l o g ( f ( x ) g ( x ) ) = l o g ( f ( x ) ) + l o g ( g ( x ) ) log(f(x)g(x)) = log(f(x)) + log(g(x)) log(f(x)g(x))=log(f(x))+log(g(x))
1 f ( x ) g ( x ) d d x ( f ( x ) g ( x ) ) = 1 f ( x ) f ′ ( x ) + 1 g ( x ) g ′ ( x ) \frac{1}{f(x)g(x)}\ \frac{d}{dx}\ (f(x)g(x)) = \frac{1}{f(x)} f'(x)\ + \frac{1}{g(x)}\ g'(x) f(x)g(x)1
逻辑回归求导证明
最新推荐文章于 2023-05-29 14:41:30 发布
本文详细介绍了逻辑回归中sigmoid函数、损失函数的定义,并通过求导公式推导出损失函数关于预测值a的梯度,即da/dL = a - y。
摘要由CSDN通过智能技术生成