协方差矩阵

在统计学与概率论中,协方差矩阵的每个元素是各个向量元素之间的协方差,是从标量随机变量到高维度随机向量的自然推广

  • 概念

设 https://gss2.bdstatic.com/9fo3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D143/sign=c2358fc73aadcbef05347a029fae2e0e/5fdf8db1cb1349541bb45e675d4e9258d1094a0e.jpg  为n维随机变量,称矩阵

https://gss0.bdstatic.com/94o3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D241/sign=c0a38ac73aadcbef053479029daf2e0e/8cb1cb1349540923cd55d07d9958d109b3de49f0.jpg

为n维随机变量 https://gss3.bdstatic.com/7Po3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D12/sign=fd7656250224ab18e416e53535fa4b70/91529822720e0cf378dafdf80146f21fbe09aa80.jpg  的协方差矩阵(covariance matrix),也记为 https://gss0.bdstatic.com/-4o3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D37/sign=4d95bf322a3fb80e08d167d037d12ce7/38dbb6fd5266d01645582d2b9c2bd40735fa356b.jpg  ,其中

https://gss1.bdstatic.com/9vo3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D218/sign=290598ceaaefce1bee2bcfcb9750f3e8/a71ea8d3fd1f41342ee0de46281f95cad1c85e37.jpg

为 https://gss3.bdstatic.com/7Po3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D12/sign=fd7656250224ab18e416e53535fa4b70/91529822720e0cf378dafdf80146f21fbe09aa80.jpg  的分量 https://gss1.bdstatic.com/9vo3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D16/sign=b9bfa32c9ecad1c8d4bbf8217e3e115b/9f2f070828381f3060d53eaaa2014c086f06f0e1.jpg  和 https://gss3.bdstatic.com/-Po3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D19/sign=cda90de7b81c8701d2b6b6ef267fb746/0df431adcbef7609a8ec2a9c25dda3cc7dd99eca.jpg  的协方差(设它们都存在)。

例如,二维随机变量 https://gss1.bdstatic.com/-vo3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D55/sign=1afb2cf1761ed21b7dc92ee0ac6e77d6/f603918fa0ec08facc52aea452ee3d6d55fbda67.jpg  的协方差矩阵为

https://gss0.bdstatic.com/-4o3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D104/sign=d57621df8113632711edc633a58ea056/359b033b5bb5c9ead167bee0de39b6003af3b319.jpg

其中 

https://gss0.bdstatic.com/-4o3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D375/sign=44f61211790e0cf3a4f748fc3f47f23d/b17eca8065380cd745871deeaa44ad345982811c.jpg

https://gss0.bdstatic.com/-4o3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D375/sign=4e01dc1f1adfa9ecf92e501057d1f754/d62a6059252dd42a94e6bfa8083b5bb5c8eab8c2.jpg

由于 https://gss2.bdstatic.com/-fo3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D158/sign=b47683c710d5ad6eaef960efb9ca39a3/b219ebc4b74543a9e44b42cf15178a82b9011464.jpg  ,所以协方差矩阵对称非负定矩阵

  • 性质

协方差矩阵具有如下性质:

(1) https://gss0.bdstatic.com/-4o3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D161/sign=8be7ab9a8926cffc6d2abbb488004a7d/63d0f703918fa0ec3458b90e2d9759ee3d6ddb12.jpg .

(2) https://gss1.bdstatic.com/-vo3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D200/sign=d9386ea7afc27d1ea1263cc42bd5adaf/42a98226cffc1e17878550324190f603738de9ff.jpg  ,其中A是矩阵,b是向量。

(3) https://gss0.bdstatic.com/-4o3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D261/sign=5d16fcfd3dd3d539c53d08c50b86e927/4ec2d5628535e5dd73ed79dc7dc6a7efcf1b62f4.jpg  。

  • 应用

协方差矩阵可用来表示多维随机变量的概率密度,从而可通过协方差矩阵达到对多维随机变量的研究。以二维随机变量 https://gss3.bdstatic.com/7Po3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D55/sign=a0203e518e35e5dd942ca5da77c6224a/34fae6cd7b899e51e051e41749a7d933c9950dd2.jpg  为例,由于

https://gss3.bdstatic.com/-Po3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D633/sign=38d10c309945d688a702b1a797c27dab/faedab64034f78f00c1a5ff072310a55b3191ca4.jpg

引入矩阵https://gss3.bdstatic.com/-Po3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D61/sign=720ae5fd3dd3d539c53d0cc23b87f040/fc1f4134970a304e9eff65f9dac8a786c8175cd0.jpg  , https://gss0.bdstatic.com/94o3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D59/sign=714d5c075282b2b7a39f39cd31addb77/c9fcc3cec3fdfc03424c27bbdf3f8794a4c226f9.jpg 及 https://gss3.bdstatic.com/7Po3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D55/sign=a0203e518e35e5dd942ca5da77c6224a/34fae6cd7b899e51e051e41749a7d933c9950dd2.jpg  的协方差矩阵

https://gss3.bdstatic.com/-Po3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D238/sign=ca7652df03fa513d55aa6bdd056c554c/023b5bb5c9ea15ce6d2a270abd003af33b87b2e9.jpg

由此可得

https://gss2.bdstatic.com/-fo3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D475/sign=2f108a0d6c09c93d03f20ff0aa3df8bb/e7cd7b899e510fb3e923b794d233c895d1430cff.jpg

由于

https://gss3.bdstatic.com/7Po3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D512/sign=6e8767619322720e7fcee2fb49ca0a3a/b17eca8065380cd7f65360eeaa44ad3459828160.jpg

https://gss3.bdstatic.com/7Po3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D387/sign=7eaac0e8bdfd5266a32b3a1c9c199799/cefc1e178a82b901b5f10f30788da9773912ef52.jpg

于是 https://gss3.bdstatic.com/7Po3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D55/sign=a0203e518e35e5dd942ca5da77c6224a/34fae6cd7b899e51e051e41749a7d933c9950dd2.jpg  的概率密度

https://gss2.bdstatic.com/9fo3dSag_xI4khGkpoWK1HF6hhy/baike/s%3D402/sign=cad17a2b3d7adab439d01a43b9d5b36b/b3fb43166d224f4a126cba1002f790529822d138.jpg

此式可以推广到n维正态分布的情形。

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值