UA MATH571B Things to know about statistical model of experimental design
Experimental with one treatment factor
Simple Experiment (Randomized Complete Design)
Balanced
Statistical Model is
y
i
j
=
μ
+
τ
i
+
ϵ
i
j
,
i
=
1
,
⋯
,
a
,
j
=
1
,
⋯
,
n
y_{ij} = \mu + \tau_i + \epsilon_{ij},i=1,\cdots,a,j = 1,\cdots,n
yij=μ+τi+ϵij,i=1,⋯,a,j=1,⋯,n
μ \mu μ is the grand mean, τ i \tau_i τi is the treatment effect of factor level i i i.
Assumptions:
- Fixed Effect: ∑ i = 1 a τ i = 0 \sum_{i=1}^a \tau_i = 0 ∑i=1aτi=0
- Homogenous normality: ϵ i j ∼ i i d N ( 0 , σ 2 ) \epsilon_{ij} \sim_{iid} N(0,\sigma^2) ϵij∼iidN(0,σ2)
ANOVA table is (
N
=
n
a
N=na
N=na)
Hypothesises of ANOVA F test is
H
0
:
τ
1
=
⋯
=
τ
a
=
0
H
a
:
a
t
l
e
a
s
t
o
n
e
i
s
n
o
t
z
e
r
o
H_0:\tau_1 = \cdots = \tau_a = 0 \\ H_a:at\ least\ one\ is\ not\ zero
H0:τ1=⋯=τa=0Ha:at least one is not zero
And the rejection rule is F 0 > F 1 − α , a − 1 , N − a F_0>F_{1-\alpha,a-1,N-a} F0>F1−α,a−1,N−a.
OLS estimators for the parameters are
Unbalanced
Statistical Model is
y
i
j
=
μ
+
τ
i
+
ϵ
i
j
,
i
=
1
,
⋯
,
a
,
j
=
1
,
⋯
,
n
i
y_{ij} = \mu + \tau_i + \epsilon_{ij},i=1,\cdots,a,j = 1,\cdots,n_i
yij=μ+τi+ϵij,i=1,⋯,a,j=1,⋯,ni
μ \mu μ is the grand mean, τ i \tau_i τi is the treatment effect of factor level i i i.
Assumptions:
- Fixed Effect: ∑ i = 1 a τ i = 0 \sum_{i=1}^a \tau_i = 0 ∑i=1aτi=0
- Homogenous normality: ϵ i j ∼ i i d N ( 0 , σ 2 ) \epsilon_{ij} \sim_{iid} N(0,\sigma^2) ϵij∼iidN(0,σ2)
RCBD
y i j = μ + τ i + β j + ϵ i j ϵ i j ∼ i i d N ( 0 , σ 2 ) ; i = 1 , ⋯ , a ; j = 1 , ⋯ , b y_{ij} = \mu + \tau_i + \beta_j + \epsilon_{ij}\\ \epsilon_{ij} \sim_{iid}N(0,\sigma^2);i=1,\cdots,a;j=1,\cdots,b yij=μ+τi+βj+ϵijϵij∼iidN(0,σ2);i=1,⋯,a;j=1,⋯,b
where τ i \tau_i τi means treatment effect and β j \beta_j βj means blocking effect.
Assumptions:
- Fixed Effect: ∑ i = 1 a τ i = 0 , ∑ i = 1 b β j = 0 \sum_{i=1}^a \tau_i = 0,\sum_{i=1}^b \beta_j = 0 ∑i=1aτi=0,∑i=1bβj=0
- Homogenous normality: ϵ i j ∼ i i d N ( 0 , σ 2 ) \epsilon_{ij} \sim_{iid} N(0,\sigma^2) ϵij∼iidN(0,σ2)
ANOVA table is
Source | SS | df | MS | F |
---|---|---|---|---|
Treatment | S S M SSM SSM | a-1 | M S M = S S M d f M MSM = \frac{SSM}{df_M} MSM=dfMSSM | F M = M S M / M S E F_M=MSM/MSE FM=MSM/MSE |
Blocking | S S B SSB SSB | b-1 | M S B = S S B d f B MSB=\frac{SSB}{df_B} MSB=dfBSSB | F B = M S B / M S E F_B = MSB/MSE FB=MSB/MSE |
Residuals | S S E SSE SSE | (a-1)(b-1) | M S E = S S E d f E MSE = \frac{SSE}{df_E} MSE=dfESSE | |
Total | S S T SST SST | N-1 | M S T = S S T d f T MST = \frac{SST}{df_T} MST=dfTSST |
∑
i
=
1
a
∑
j
=
1
b
(
y
i
j
+
y
ˉ
.
.
−
y
ˉ
i
.
−
y
ˉ
.
j
)
2
=
∑
i
=
1
a
∑
j
=
1
b
e
i
j
2
=
S
S
E
∑
i
=
1
a
∑
j
=
1
b
(
y
ˉ
.
j
−
y
ˉ
.
.
)
2
=
∑
i
=
1
a
∑
j
=
1
b
β
^
j
2
=
S
S
B
∑
i
=
1
a
∑
j
=
1
b
(
y
ˉ
i
.
−
y
ˉ
.
.
)
2
=
∑
i
=
1
a
∑
j
=
1
b
τ
^
i
2
=
S
S
M
S
S
T
=
S
S
M
+
S
S
B
+
S
S
E
\sum_{i=1}^a \sum_{j=1}^b (y_{ij}+\bar{y}_{..} - \bar{y}_{i.} - \bar{y}_{.j})^2 = \sum_{i=1}^a \sum_{j=1}^b e_{ij}^2 = SSE \\ \sum_{i=1}^a \sum_{j=1}^b (\bar{y}_{.j}-\bar{y}_{..})^2 = \sum_{i=1}^a \sum_{j=1}^b \hat{\beta}_j^2 = SSB\\ \sum_{i=1}^a \sum_{j=1}^b (\bar{y}_{i.}-\bar{y}_{..})^2 = \sum_{i=1}^a \sum_{j=1}^b \hat{\tau}_i^2 = SSM \\ SST=SSM+SSB+SSE
i=1∑aj=1∑b(yij+yˉ..−yˉi.−yˉ.j)2=i=1∑aj=1∑beij2=SSEi=1∑aj=1∑b(yˉ.j−yˉ..)2=i=1∑aj=1∑bβ^j2=SSBi=1∑aj=1∑b(yˉi.−yˉ..)2=i=1∑aj=1∑bτ^i2=SSMSST=SSM+SSB+SSE
Parameter estimation:
y
i
.
=
∑
j
=
1
b
y
i
j
,
y
ˉ
i
.
=
y
i
.
b
y
.
j
=
∑
i
=
1
a
y
i
j
,
y
ˉ
.
j
=
y
.
j
a
y
.
.
=
∑
i
=
1
a
y
i
.
=
∑
j
=
1
b
y
.
j
,
y
ˉ
.
.
=
y
.
.
N
,
N
=
a
b
τ
^
i
=
y
ˉ
i
.
−
y
ˉ
.
.
,
β
^
j
=
y
ˉ
.
j
−
y
ˉ
.
j
,
e
i
j
=
y
i
j
−
y
ˉ
i
.
−
y
ˉ
.
j
+
y
ˉ
.
.
y_{i.} = \sum_{j=1}^b y_{ij}, \bar{y}_{i.} = \frac{y_{i.}}{b} \\ y_{.j} = \sum_{i=1}^a y_{ij}, \bar{y}_{.j} = \frac{y_{.j}}{a} \\ y_{..} = \sum_{i=1}^a y_{i.}=\sum_{j=1}^b y_{.j}, \bar{y}_{..} = \frac{y_{..}}{N},N=ab \\ \hat{\tau}_i = \bar{y}_{i.}-\bar{y}_{..},\hat{\beta}_j=\bar{y}_{.j}-\bar{y}_{.j},e_{ij}=y_{ij} - \bar{y}_{i.} - \bar{y}_{.j} + \bar{y}_{..}
yi.=j=1∑byij,yˉi.=byi.y.j=i=1∑ayij,yˉ.j=ay.jy..=i=1∑ayi.=j=1∑by.j,yˉ..=Ny..,N=abτ^i=yˉi.−yˉ..,β^j=yˉ.j−yˉ.j,eij=yij−yˉi.−yˉ.j+yˉ..
Latin Square Design
Graeco-Latin Square Design
BIBD
Experimental with multiple treatment factors
Factorial design with fixed factors
Factorial design with random factors
Factorial design with mixed factors
Nested design
Split-plot design