矩阵求导规则

注 : \color{#DC143C}{注:} :
1 ) 内 容 从 属 于 向 量 微 积 分 \color{#4285f4}{1)内容从属于向量微积分} 1)
2 ) 标 量 使 用 小 写 字 母 表 示 , 矩 阵 、 向 量 均 使 用 大 写 字 母 表 示 \color{#4285f4}{2)标量使用小写字母表示,矩阵、向量均使用大写字母表示} 2)使使
3 ) 均 采 用 分 子 布 局 , 也 称 混 合 布 局 , 即 对 向 量 与 矩 阵 求 导 时 需 转 置 \color{#4285f4}{3)均采用分子布局,也称混合布局,即对向量与矩阵求导时需转置} 3)
4 ) 部 分 资 料 约 定 不 一 致 , 有 争 议 的 部 分 以 相 应 资 料 为 准 \color{#4285f4}{4)部分资料约定不一致,有争议的部分以相应资料为准} 4)

1. 对元素求导

1.1 矩阵对元素求导

∂ Y ∂ x = [ ∂ y 11 ∂ x ∂ y 12 ∂ x ∂ y 13 ∂ x ∂ y 21 ∂ x ∂ y 22 ∂ x ∂ y 23 ∂ x ∂ y 31 ∂ x ∂ y 32 ∂ x ∂ y 33 ∂ x ] \frac {\partial{Y}}{\partial{x}} = \left[ \begin{matrix} \frac {\partial{y_{11}}}{\partial{x}} & \frac {\partial{y_{12}}}{\partial{x}} & \frac {\partial{y_{13}}}{\partial{x}} \\ \frac {\partial{y_{21}}}{\partial{x}} & \frac {\partial{y_{22}}}{\partial{x}} & \frac {\partial{y_{23}}}{\partial{x}} \\ \frac {\partial{y_{31}}}{\partial{x}} & \frac {\partial{y_{32}}}{\partial{x}} & \frac {\partial{y_{33}}}{\partial{x}} \end{matrix} \right] xY=xy11xy21xy31xy12xy22xy32xy13xy23xy33

1.2 向量对元素求导

∂ Y T ∂ x = [ ∂ y 1 ∂ x ∂ y 2 ∂ x ∂ y 3 ∂ x ] \frac {\partial{Y^T}}{\partial{x}} = \left[ \begin{matrix} \frac {\partial{y_{1}}}{\partial{x}} & \frac {\partial{y_{2}}}{\partial{x}} & \frac {\partial{y_{3}}}{\partial{x}} \end{matrix} \right] xYT=[xy1xy2xy3]
∂ Y ∂ x = [ ∂ y 1 ∂ x ∂ y 2 ∂ x ∂ y 3 ∂ x ] \frac {\partial{Y}}{\partial{x}} = \left[ \begin{matrix} \frac {\partial{y_{1}}}{\partial{x}} \\ \frac {\partial{y_{2}}}{\partial{x}} \\ \frac {\partial{y_{3}}}{\partial{x}} \end{matrix} \right] xY=xy1xy2xy3

2. 对向量求导

2.1 元素对向量求导

∂ y ∂ X = [ ∂ y ∂ x 1 ∂ y ∂ x 2 ∂ y ∂ x 3 ] \frac {\partial{y}}{\partial{X}} = \left[ \begin{matrix} \frac {\partial{y}}{\partial{x_1}} & \frac {\partial{y}}{\partial{x_2}} & \frac {\partial{y}}{\partial{x_3}} \end{matrix} \right] Xy=[x1yx2yx3y]
∂ y ∂ X T = [ ∂ y ∂ x 1 ∂ y ∂ x 2 ∂ y ∂ x 3 ] \frac {\partial{y}}{\partial{X^T}} = \left[ \begin{matrix} \frac {\partial{y}}{\partial{x_1}} \\ \frac {\partial{y}}{\partial{x_2}} \\ \frac {\partial{y}}{\partial{x_3}} \end{matrix} \right] XTy=x1yx2yx3y

2.2 向量对向量求导

∂ Y T ∂ X = [ ∂ Y T ∂ x 1 ∂ Y T ∂ x 2 ∂ Y T ∂ x 3 ] , ∂ Y ∂ X = [ ∂ Y ∂ x 1 ∂ Y ∂ x 2 ∂ Y ∂ x 3 ] , \frac {\partial{Y^T}}{\partial{X}} = \left[ \begin{matrix} \frac {\partial{Y^T}}{\partial{x_1}} & \frac {\partial{Y^T}}{\partial{x_2}} & \frac {\partial{Y^T}}{\partial{x_3}} \end{matrix} \right] , \frac {\partial{Y}}{\partial{X}} = \left[ \begin{matrix} \frac {\partial{Y}}{\partial{x_1}} & \frac {\partial{Y}}{\partial{x_2}} & \frac {\partial{Y}}{\partial{x_3}} \end{matrix} \right], XYT=[x1YTx2YTx3YT],XY=[x1Yx2Yx3Y],
∂ Y T ∂ X T = [ ∂ Y T ∂ x 1 ∂ Y T ∂ x 2 ∂ Y T ∂ x 3 ] , ∂ Y ∂ X T = [ ∂ Y ∂ x 1 ∂ Y ∂ x 2 ∂ Y ∂ x 3 ] \frac {\partial{Y^T}}{\partial{X^T}} = \left[ \begin{matrix} \frac {\partial{Y^T}}{\partial{x_1}} \\ \frac {\partial{Y^T}}{\partial{x_2}} \\ \frac {\partial{Y^T}}{\partial{x_3}} \end{matrix} \right], \frac {\partial{Y}}{\partial{X^T}} = \left[ \begin{matrix} \frac {\partial{Y}}{\partial{x_1}} \\ \frac {\partial{Y}}{\partial{x_2}} \\ \frac {\partial{Y}}{\partial{x_3}} \end{matrix} \right] XTYT=x1YTx2YTx3YT,XTY=x1Yx2Yx3Y

2.3 矩阵对向量求导

∂ Y ∂ X = [ ∂ Y ∂ x 1 ∂ Y ∂ x 2 ∂ Y ∂ x 3 ] \frac {\partial{Y}}{\partial{X}} = \left[ \begin{matrix} \frac {\partial{Y}}{\partial{x_1}} & \frac {\partial{Y}}{\partial{x_2}} & \frac {\partial{Y}}{\partial{x_3}} \end{matrix} \right] XY=[x1Yx2Yx3Y]
∂ Y ∂ X T = [ ∂ Y ∂ x 1 ∂ Y ∂ x 2 ∂ Y ∂ x 3 ] \frac {\partial{Y}}{\partial{X^T}} = \left[ \begin{matrix} \frac {\partial{Y}}{\partial{x_1}} \\ \frac {\partial{Y}}{\partial{x_2}} \\ \frac {\partial{Y}}{\partial{x_3}} \end{matrix} \right] XTY=x1Yx2Yx3Y

3. 对矩阵求导

3.1 元素对矩阵求导

∂ y ∂ X = [ ∂ y ∂ x 11 ∂ y ∂ x 21 ∂ y ∂ x 31 ∂ y ∂ x 12 ∂ y ∂ x 22 ∂ y ∂ x 32 ∂ y ∂ x 13 ∂ y ∂ x 23 ∂ y ∂ x 33 ] \frac {\partial{y}}{\partial{X}} = \left[ \begin{matrix} \frac {\partial{y}}{\partial{x_{11}}} & \frac {\partial{y}}{\partial{x_{21}}} & \frac {\partial{y}}{\partial{x_{31}}} \\ \frac {\partial{y}}{\partial{x_{12}}} & \frac {\partial{y}}{\partial{x_{22}}} & \frac {\partial{y}}{\partial{x_{32}}} \\ \frac {\partial{y}}{\partial{x_{13}}} & \frac {\partial{y}}{\partial{x_{23}}} & \frac {\partial{y}}{\partial{x_{33}}} \end{matrix} \right] Xy=x11yx12yx13yx21yx22yx23yx31yx32yx33y

3.2 向量对矩阵求导

∂ Y ∂ X = [ ∂ Y ∂ x 11 ∂ Y ∂ x 21 ∂ Y ∂ x 31 ∂ Y ∂ x 12 ∂ Y ∂ x 22 ∂ Y ∂ x 32 ∂ Y ∂ x 13 ∂ Y ∂ x 23 ∂ Y ∂ x 33 ] , ∂ Y T ∂ X = [ ∂ Y T ∂ x 11 ∂ Y T ∂ x 21 ∂ Y T ∂ x 31 ∂ Y T ∂ x 12 ∂ Y T ∂ x 22 ∂ Y T ∂ x 32 ∂ Y T ∂ x 13 ∂ Y T ∂ x 23 ∂ Y T ∂ x 33 ] \frac {\partial{Y}}{\partial{X}} = \left[ \begin{matrix} \frac {\partial{Y}}{\partial{x_{11}}} & \frac {\partial{Y}}{\partial{x_{21}}} & \frac {\partial{Y}}{\partial{x_{31}}} \\ \frac {\partial{Y}}{\partial{x_{12}}} & \frac {\partial{Y}}{\partial{x_{22}}} & \frac {\partial{Y}}{\partial{x_{32}}} \\ \frac {\partial{Y}}{\partial{x_{13}}} & \frac {\partial{Y}}{\partial{x_{23}}} & \frac {\partial{Y}}{\partial{x_{33}}} \end{matrix} \right] , \frac {\partial{Y^T}}{\partial{X}} = \left[ \begin{matrix} \frac {\partial{Y^T}}{\partial{x_{11}}} & \frac {\partial{Y^T}}{\partial{x_{21}}} & \frac {\partial{Y^T}}{\partial{x_{31}}} \\ \frac {\partial{Y^T}}{\partial{x_{12}}} & \frac {\partial{Y^T}}{\partial{x_{22}}} & \frac {\partial{Y^T}}{\partial{x_{32}}} \\ \frac {\partial{Y^T}}{\partial{x_{13}}} & \frac {\partial{Y^T}}{\partial{x_{23}}} & \frac {\partial{Y^T}}{\partial{x_{33}}} \end{matrix} \right] XY=x11Yx12Yx13Yx21Yx22Yx23Yx31Yx32Yx33Y,XYT=x11YTx12YTx13YTx21YTx22YTx23YTx31YTx32YTx33YT

3.3 矩阵对矩阵求导

注 : 有 争 议 , 以 具 体 资 料 为 准 \color{#DC143C}{注:}\color{#4285f4}{有争议,以具体资料为准}

∂ Y ∂ X = [ ∂ Y ∂ x 11 ∂ Y ∂ x 21 ∂ Y ∂ x 31 ∂ Y ∂ x 12 ∂ Y ∂ x 22 ∂ Y ∂ x 32 ∂ Y ∂ x 13 ∂ Y ∂ x 23 ∂ Y ∂ x 33 ] \frac {\partial{Y}}{\partial{X}} = \left[ \begin{matrix} \frac {\partial{Y}}{\partial{x_{11}}} & \frac {\partial{Y}}{\partial{x_{21}}} & \frac {\partial{Y}}{\partial{x_{31}}} \\ \frac {\partial{Y}}{\partial{x_{12}}} & \frac {\partial{Y}}{\partial{x_{22}}} & \frac {\partial{Y}}{\partial{x_{32}}} \\ \frac {\partial{Y}}{\partial{x_{13}}} & \frac {\partial{Y}}{\partial{x_{23}}} & \frac {\partial{Y}}{\partial{x_{33}}} \end{matrix} \right] XY=x11Yx12Yx13Yx21Yx22Yx23Yx31Yx32Yx33Y

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值