【机器学习】矩阵求导总结

公式推导皆以分母布局(即分子为行向量或者分母为列向量), x = [ x 1 x 2 ⋯ x n ] T x = \begin{bmatrix} x_{1} x_{2}\cdots x_{n} \end{bmatrix}^T x=[x1x2xn]T, ∂ y ∂ x = [ ∂ y ∂ x ] = [ ∂ y ∂ x 1 ∂ y ∂ x 2 ⋮ ∂ y ∂ x n ] \frac{\partial y}{\partial x} = [\frac{\partial y}{\partial x}] =\begin{bmatrix} \frac{\partial y}{\partial x_{1}}\\ \frac{\partial y}{\partial x_{2}}\\ \vdots\\ \frac{\partial y}{\partial x_{n}}\\ \end{bmatrix} xy=[xy]=x1yx2yxny

  1. f ( x ) = x T A x f(x)=x^TAx f(x)=xTAx,则

∂ f ( x ) ∂ x = ∂ x T A x ∂ x = ∂ x T A x ∂ x + ∂ x T A x ∂ x = A x + A T x   \frac {\partial f(x)} {\partial x} = \frac {\partial x^TAx} {\partial x} = \frac {\partial \textcolor{red}{x^T}Ax} {\partial x} + \frac {\partial x^TA\textcolor{red}{x}} {\partial x} = Ax+A^Tx\\\ xf(x)=xxTAx=xxTAx+xxTAx=Ax+ATx 

  1. f ( x ) = x T A T A y f(x)=x^TA^TAy f(x)=xTATAy,则

∂ f ( x ) ∂ A = ∂ x T A T A y ∂ A = ∂ x T A T A y ∂ A + ∂ x T A T A y ∂ A = A y x T + A x y T   \frac {\partial f(x)} {\partial A} = \frac {\partial x^TA^TAy} {\partial A} = \frac {\partial x^T \textcolor{red}{A^T}Ay} {\partial A} + \frac {\partial x^TA^T \textcolor{red}{A}y} {\partial A} = Ayx^T + Axy^T\\\ Af(x)=AxTATAy=AxTATAy+AxTATAy=AyxT+AxyT 

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值