钟型曲线(gauss曲线)
f
(
x
)
=
e
−
x
2
2
f(x)=e^{-\frac{x^2}{2}}
f(x)=e−2x2其导数为
f
′
(
x
)
=
e
−
x
2
2
⋅
x
=
f
(
x
)
⋅
x
f'(x)=e^{-\frac{x^2}{2}} \cdot x=f(x) \cdot x
f′(x)=e−2x2⋅x=f(x)⋅x当
x
→
−
∞
x\rightarrow -\infty
x→−∞时,
f
(
x
)
→
0
f(x)\rightarrow 0
f(x)→0,
f
′
(
x
)
→
0
f'(x) \rightarrow 0
f′(x)→0
当
x
→
0
x\rightarrow 0
x→0时,
f
(
x
)
→
1
f(x)\rightarrow 1
f(x)→1,
f
′
(
x
)
→
0
f'(x) \rightarrow 0
f′(x)→0
当
x
→
+
∞
x\rightarrow +\infty
x→+∞时,
f
(
x
)
→
0
f(x)\rightarrow 0
f(x)→0,
f
′
(
x
)
→
0
f'(x) \rightarrow 0
f′(x)→0
S型曲线
sigmoid曲线
σ
(
x
)
=
1
1
+
e
−
x
\sigma(x)=\frac{1}{1+e^{-x}}
σ(x)=1+e−x1其导数为
σ
′
(
x
)
=
e
−
x
1
+
e
−
x
⋅
1
1
+
e
−
x
=
(
1
−
σ
(
x
)
)
⋅
σ
(
x
)
\sigma'(x)=\frac{e^{-x}}{1+e^{-x}}\cdot \frac{1}{1+e^{-x}}=(1-\sigma(x))\cdot \sigma(x)
σ′(x)=1+e−xe−x⋅1+e−x1=(1−σ(x))⋅σ(x)
σ
′
(
x
)
=
1
e
x
+
e
−
x
+
2
\sigma'(x)=\frac{1}{e^x+e^{-x}+2}
σ′(x)=ex+e−x+21当
x
→
−
∞
x\rightarrow -\infty
x→−∞时,
σ
(
x
)
→
0
\sigma(x)\rightarrow 0
σ(x)→0,
σ
′
(
x
)
→
0
\sigma'(x) \rightarrow 0
σ′(x)→0
当
x
→
0
x\rightarrow 0
x→0时,
σ
(
x
)
→
1
2
\sigma(x)\rightarrow \frac{1}{2}
σ(x)→21,
σ
′
(
x
)
→
1
4
\sigma'(x) \rightarrow \frac{1}{4}
σ′(x)→41
当
x
→
+
∞
x\rightarrow +\infty
x→+∞时,
σ
(
x
)
→
1
\sigma(x)\rightarrow 1
σ(x)→1,
σ
′
(
x
)
→
0
\sigma'(x) \rightarrow 0
σ′(x)→0
双曲正切函数曲线 t h ( x ) th(x) th(x)
t h ( x ) = e x − e − x e x + e − x th(x)=\frac{e^x-e^{-x}}{e^x+e^{-x}} th(x)=ex+e−xex−e−x与sigmoid曲线的关系: t h ( x ) + 1 = 2 ⋅ σ ( 2 x ) th(x)+1=2\cdot \sigma(2x) th(x)+1=2⋅σ(2x)