梯度向量的表达式为:
[
∂
f
∂
x
1
∂
f
∂
x
2
.
.
.
∂
f
∂
x
n
]
=
[
∂
f
∂
x
1
∂
f
∂
x
2
.
.
∂
f
∂
x
n
]
T
\left[ \begin{array} { c c } {\frac {\partial{f}} {\partial x_{1}}} \\ {\frac {\partial{f}} {\partial x_{2}}} \\ ...& \\ {\frac {\partial{f}} {\partial x_{n}}} \end{array} \right] = \left[ \begin{array} { c c } {\frac {\partial{f}} {\partial x_{1}}} & {\frac {\partial{f}} {\partial x_{2}}} ..& & {\frac {\partial{f}} {\partial x_{n}}} \end{array} \right]^{T}
⎣⎢⎢⎢⎡∂x1∂f∂x2∂f...∂xn∂f⎦⎥⎥⎥⎤=[∂x1∂f∂x2∂f..∂xn∂f]T
雅克比矩阵的表达式为:
[
∂
y
1
∂
x
1
∂
y
1
∂
x
2
.
.
.
∂
y
1
∂
x
n
∂
y
2
∂
x
1
∂
y
2
∂
x
2
.
.
.
∂
y
2
∂
x
n
.
.
.
.
.
.
.
.
.
.
.
.
∂
y
m
∂
x
1
∂
y
m
∂
x
2
.
.
.
∂
y
m
∂
x
n
]
\left[ \begin{array} { c c } {\frac {\partial{y_{1}}} {\partial x_{1}}} & { \frac {\partial{y_{1}}} {\partial x_{2}} } &...& { \frac {\partial{y_{1}}} {\partial x_{n}} } \\ {\frac {\partial{y_{2}}} {\partial x_{1}}} & { \frac {\partial{y_{2}}} {\partial x_{2}} } &...& { \frac {\partial{y_{2}}} {\partial x_{n}} } \\ ...& ... & ...& ... \\ {\frac {\partial{y_{m}}} {\partial x_{1}}} & { \frac {\partial{y_{m}}} {\partial x_{2}} } &...& { \frac {\partial{y_{m}}} {\partial x_{n}} } \end{array} \right]
⎣⎢⎢⎢⎡∂x1∂y1∂x1∂y2...∂x1∂ym∂x2∂y1∂x2∂y2...∂x2∂ym............∂xn∂y1∂xn∂y2...∂xn∂ym⎦⎥⎥⎥⎤
从表达式来看,是对多个y和多个x之间的关系,这表示的并不是多元函数,而是多元函数方程组之间的偏导关系。
海森矩阵的表达式为:
[
∂
2
f
∂
x
1
2
∂
2
f
∂
x
1
∂
x
2
.
.
.
∂
2
f
∂
x
1
∂
x
n
∂
2
f
∂
x
2
∂
x
1
∂
2
f
∂
x
2
2
.
.
.
∂
2
f
∂
x
2
∂
x
n
.
.
.
.
.
.
.
.
.
.
.
.
∂
2
f
∂
x
n
∂
x
1
∂
2
f
∂
x
n
∂
x
2
.
.
.
∂
2
f
∂
x
n
2
]
\left[ \begin{array} { c c } {\frac {\partial ^{2}{f}} {\partial x_{1}^{2} }} & { \frac {\partial ^{2}{f}} {\partial x_{1} \partial x_{2}} } &...& { \frac {\partial ^{2}{f}} {\partial x_{1} \partial x_{n}} } \\ {\frac {\partial^{2} {f}} {\partial x_{2} \partial x_{1}}} & { \frac {\partial ^{2}{f}} {\partial x_{2}^{2}} } &...& { \frac {\partial ^{2}{f}} {\partial x_{2} \partial x_{n}} } \\ ...& ... & ...& ... \\ {\frac {\partial ^{2}{f}} {\partial x_{n} \partial x_{1}}} & { \frac {\partial ^{2}{f}} {\partial x_{n} \partial x_{2}} } &...& { \frac {\partial ^{2}{f}} {\partial x_{n}^{2}} } \end{array} \right]
⎣⎢⎢⎢⎢⎡∂x12∂2f∂x2∂x1∂2f...∂xn∂x1∂2f∂x1∂x2∂2f∂x22∂2f...∂xn∂x2∂2f............∂x1∂xn∂2f∂x2∂xn∂2f...∂xn2∂2f⎦⎥⎥⎥⎥⎤
多元泰勒公式的表达式为:
f
(
x
)
=
f
(
x
0
)
+
(
∇
f
(
x
0
)
)
T
(
x
−
x
0
)
+
1
2
!
(
x
−
x
0
)
T
H
(
x
0
)
(
x
−
x
0
)
+
O
(
x
−
x
0
)
2
f(x)=f(x_{0}) + ({\nabla f(x_{0})})^{T}(x-x_{0})+ \frac{1}{2!} {(x-x_{0})}^TH(x_{0})(x-x_{0})+O{(x-x_{0})}^{2}
f(x)=f(x0)+(∇f(x0))T(x−x0)+2!1(x−x0)TH(x0)(x−x0)+O(x−x0)2