chi-square test & T-test & F-test & correlation-analysis

Without other qualification, 'chi-squared test' often is used as short for Pearson's chi-squared test.A chi-squared test can be used to attempt rejection of the null hypothesis that the data are independent.The chi-squared test is used to determine whether there is a significant difference between the expected frequencies and the observed frequencies in one or more categories.

Other chi-squared tests

 

wald test

Test on a single parameter

In the univariate case, the Wald statistic is

\frac{ ( \widehat{ \theta}-\theta_0 )^2 }{\operatorname{var}(\hat \theta )}

which is compared against a chi-squared distribution.

Alternatively, the difference can be compared to a normal distribution. In this case the test statistic is

\frac{\widehat{\theta}-\theta_0}{\operatorname{se}(\hat\theta)}

where \operatorname{se}(\widehat\theta) is the standard error of the maximum likelihood estimate (MLE). A reasonable estimate of the standard error for the MLE can be given by \frac{1}{\sqrt{I_n(MLE)}}, whereI_n is the Fisher information of the parameter.

Test(s) on multiple parameters

The Wald test can be used to test a single hypothesis on multiple parameters, as well as to test jointly multiple hypotheses on single/multiple parameters. Let  {\hat  {\theta }}_{n} be our sample estimator of P parameters (i.e., {\hat  {\theta }}_{n} is a Px1 vector), which is supposed to follow asymptotically a normal distribution with covariance matrix V,  {\sqrt  {n}}({\hat  {\theta }}_{n}-\theta ){\xrightarrow  {​{\mathcal  {D}}}}N(0,V). The test of Q hypotheses on the P parameters is expressed with a Q x P matrix R:

H_{0}:R\theta =r
H_{1}:R\theta \neq r

The test statistic is:

(R\hat{\theta}_n-r)^{'}[R(\hat{V}_n/n)R^{'}]^{-1}(R\hat{\theta}_n-r) \quad \xrightarrow{\mathcal{D}}\quad \Chi^2_Q

where {\hat  {V}}_{n} is an estimator of the covariance matrix.

 

t test 和方差分析要检验的平均数的差异,变量为连续变量,变量为渐近正态分布,而卡方检验不要求分布。

卡方检验 变量为类别变量,检验的是不同类别的数据是否在另一个变量上一致,如果不一致则这两个变量具有相关性,一致说明没有相关性,类似于交互作用的意思。

当进入回归分析的自变量为哑变量时,该自变量在该回归中,就类似于t检验,其系数值为平均差值,系数的检验采用的是t检验。

自由度为n-1的t分布 的平方等于自由度(1,n-1)F分布。
自由度为m-1的卡方/n-m-1的卡方分布为(m-1,n-m-1)F分布。
实际上t分布就是 自由度 1的卡方/自由度为n-1的卡方分布。
t检验的平方是( x平均-总体平均u)^2/标准误^2。。
标准误^2服从自由度n-1卡方分布。
(x平均-总体平均u)服从自由度(2-1)=1的卡方分布, (n-1)自由度t^2=F自由度(1,n-1)。
n足够大 t分布近似正态分布
2组样本下n不够大t分布为自由度(1,n-1)F分布。
卡方分布就是标准误^2分布。
多样本下分布自由度(m-1,n-1)F分布就是方差分析。
还可以得出一元线性回归的t检验 的平方为F检验,并与F的方差分析等价。
多元线性回归就是多因素方差分析等价。


n足够大是z或者u检验,或,t检验自由度n-1足够大t=u是一样的为正态分布,n不够大就服从t检验,卡方检验是对标准误的平方检验,信息量小于t检验,所以精确性小于t检验,这就是为什么计数资料结果是率0-1之间并且方差大,用t检验或u检验需要样本大,所以用卡方检验只看方差时就可以检验,但是卡方检验的精确性差了,加强精确性可以用logistic回归。
总之u检验,t检验,F检验,卡方检验,一元线性回归,多元性回归在一定条件下互相转化!


及对于大样本u检验,就是有多个自变量的多元线性回归就是多因素协方差分析,只有一个自变量多元线性回归变为一元线性回归,自变量x有3个或以上的值就是多样本单因素的方差分析,只有2个取值,就是2个样本单因素方差分析,就是F(1,n-1)检验,这个分布开平方就是t(n-1)检验,n足够大所以就是u检验!这就是基础统计检验的关系。

F-test

Exact "F-tests" mainly arise when the models have been fitted to the data using least squares.The name was coined by George W. Snedecor, in honour of Sir Ronald A. Fisher. Fisher initially developed the statistic as the variance ratio in the 1920s.

Common examples of F-tests

Common examples of the use of F-tests include the study of the following cases:

In addition, some statistical procedures, such as Scheffé's method for multiple comparisons adjustment in linear models, also use F-tests.

F-test of the equality of two variances

The F-test is sensitive to non-normality. In the analysis of variance (ANOVA), alternative tests include Levene's test, Bartlett's test, and the Brown–Forsythe test. However, when any of these tests are conducted to test the underlying assumption of homoscedasticity (i.e. homogeneity of variance), as a preliminary step to testing for mean effects, there is an increase in the experiment-wise Type I error rate.

转载于:https://www.cnblogs.com/JoAnnal/p/6914218.html

  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值