机器学习5 多维正态分布(高斯分布)

最新推荐文章于 2024-08-30 01:15:00 发布

skmygdrs

最新推荐文章于 2024-08-30 01:15:00 发布

阅读量6.8k

点赞数 2

分类专栏： machine_learning

本文链接：https://blog.csdn.net/skmygdrs/article/details/52076067

版权

machine_learning 专栏收录该内容

9 篇文章 0 订阅

订阅专栏

概率密度

$p(x) = {1 \over {{{\left( {2\pi } \right)}^{{n \over 2}}}{{\left| \beta \right|}^{{1 \over 2}}}}}\exp \left( { - {1 \over 2}{{\left( {x - \alpha } \right)}^T}{\beta ^{ - 1}}(x - \alpha )} \right)$ ~ $N\left( {\alpha ,\beta } \right)$
其中 $\beta = E\left[ {\left( {x - \alpha } \right){{\left( {x - \alpha } \right)}^T}} \right]$
当n=1时
令 $\beta = {\sigma ^2},\alpha = \mu$
则 $p(x) = {1 \over {\sqrt {2\pi } \sigma }}\exp \left( { - {{{{\left( {x - \mu } \right)}^2}} \over {2{\sigma ^2}}}} \right)$
当n=1时
令

β = (σ 1 2 σ 1 σ 2 r σ 1 σ 2 r σ 2 2)

$\beta = \left( {\matrix{ {{\sigma _1}^2} & {{\sigma _1}{\sigma _2}r} \cr {{\sigma _1}{\sigma _2}r} & {{\sigma _2}^2} \cr } } \right)$

α = (a, b)

$\alpha = \left( {a,b} \right)$
则

β−1=1σ12σ22(1−r2)(σ22−σ1σ2r−σ1σ2rσ12) ${\beta ^{ - 1}} = {1 \over {{\sigma _1}^2{\sigma _2}^2\left( {1 - {r^2}} \right)}}\left( {\matrix{ {{\sigma _2}^2} & { - {\sigma _1}{\sigma _2}r} \cr { - {\sigma _1}{\sigma _2}r} & {{\sigma _1}^2} \cr } } \right)$

p(x,y)=12πσ1σ21−r2√exp(−12(1−r2)[(x−a)2σ12−2r(x−a)(y−b)σ1σ2+(y−b)2σ22]) $p(x,y) = {1 \over {2\pi {\sigma _1}{\sigma _2}\sqrt {1 - {r^2}} }}\exp \left( { - {1 \over {2\left( {1 - {r^2}} \right)}}\left[ {{{{{\left( {x - a} \right)}^2}} \over {{\sigma _1}^2}} - {{2r\left( {x - a} \right)\left( {y - b} \right)} \over {{\sigma _1}{\sigma _2}}} + {{{{\left( {y - b} \right)}^2}} \over {{\sigma _2}^2}}} \right]} \right)$

二维边缘分布率

$\int_{ - \infty }^\infty {p(x,y)} dy =$
$\int_{ - \infty }^\infty {{1 \over {2\pi {\sigma _1}{\sigma _2}\sqrt {1 - {r^2}} }}\exp \left( { - {1 \over {2\left( {1 - {r^2}} \right)}}\left[ {{{{{\left( {x - a} \right)}^2}} \over {{\sigma _1}^2}} - {{2r\left( {x - a} \right)\left( {y - b} \right)} \over {{\sigma _1}{\sigma _2}}} + {{{{\left( {y - b} \right)}^2}} \over {{\sigma _2}^2}}} \right]} \right)} dy$
$= \int_{ - \infty }^\infty {{1 \over {\sqrt {2\pi } {\sigma _1}}}{1 \over {\sqrt {2\pi } {\sigma _2}\sqrt {1 - {r^2}} }}\exp \left( { - {1 \over {2\left( {1 - {r^2}} \right)}}\left[ {{{{{\left( {y - b - {{{\sigma _2}r\left( {x - a} \right)} \over {{\sigma _1}}}} \right)}^2}} \over {{\sigma _2}^2}} + \left( {1 - {r^2}} \right){{{{\left( {x - a} \right)}^2}} \over {{\sigma _1}^2}}} \right]} \right)} dy$
$= {1 \over {\sqrt {2\pi } {\sigma _1}}}\exp \left( { - {{{{\left( {x - a} \right)}^2}} \over {2{\sigma _1}^2}}} \right)$