Variance-Covariance Matrix

最新推荐文章于 2022-07-11 15:46:22 发布

ShenYounger

最新推荐文章于 2022-07-11 15:46:22 发布

阅读量5k

点赞数 2

分类专栏：数学

数学专栏收录该内容

16 篇文章 1 订阅

订阅专栏

This lesson explains how to use matrix methods to generate a variance-covariance matrix from a matrix of raw data.

Variance

Variance is a measure of the variability or spread in a set of data. Mathematically, it is the average squared deviation from the mean score. We use the following formula to compute variance.

Var(X) = Σ ( X_i - X )² / N = Σ x_i² / N

where

N is the number of scores in a set of scores
X is the mean of the N scores.
X_i is the ith raw score in the set of scores
x_i is the ith deviation score in the set of scores
Var(X) is the variance of all the scores in the set

Covariance

Covariance is a measure of the extent to which corresponding elements from two sets of ordered data move in the same direction. We use the following formula to compute covariance.

Cov(X, Y) = Σ ( X_i - X ) ( Y_i - Y ) / N = Σ x_iy_i / N

where

N is the number of scores in each set of data
X is the mean of the N scores in the first data set
X_i is the ithe raw score in the first set of scores
x_i is the ith deviation score in the first set of scores
Y is the mean of the N scores in the second data set
Y_i is the ithe raw score in the second set of scores
y_i is the ith deviation score in the second set of scores
Cov(X, Y) is the covariance of corresponding scores in the two sets of data

Variance-Covariance Matrix

Variance and covariance are often displayed together in a variance-covariance matrix, (aka, a covariance matrix). The variances appear along the diagonal and covariances appear in the off-diagonal elements, as shown below.

V =

Σ x₁² / N	Σ x₁ x₂ / N	. . .	Σ x₁ x_c / N
Σ x₂ x₁ / N	Σ x₂² / N	. . .	Σ x₂ x_c / N
. . .	. . .	. . .	. . .
Σ x_c x₁ / N	Σ x_c x₂ / N	. . .	Σ x_c² / N

where

V is a c x c variance-covariance matrix
N is the number of scores in each of the c data sets
x_i is a deviation score from the ith data set
Σ x_i² / N is the variance of elements from the ith data set
Σ x_i x_j / N is the covariance for elements from the ith and jth data sets