Testing Hypotheses in Multiple Regression: Model Comparison and Partial F-tests, Study notes of Statistics for Psychologists

An in-depth explanation of hypothesis testing in multiple regression, focusing on model comparison and partial f-tests. It covers the situation where we want to test the whole model, a single variable, or a group of variables. The document also discusses the model comparison approach in general linear model and the anova test for testing overall regression. Furthermore, it explains the procedure for testing the significance of one additional x variable and multiple additional x variables using partial f-tests. The document also introduces two strategies for partial f-tests: type i ss (variable-added-in-order test) and type iii ss (variable-added-last test).

Typology: Study notes

2011/2012

Uploaded on 11/21/2012

ashakiran
ashakiran ๐Ÿ‡ฎ๐Ÿ‡ณ

4.5

(27)

261 documents

1 / 4

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Ch. 9. Testing Hypotheses in Multiple Regression
I. Situation
Testing hypotheses about a whole model, a single variable,
or a group of variables.
II. Model Comparison Approach in General Linear Model
A. Situation: All hypothesis testing can be viewed as a
model comparison in General Linear Model which
include all multiple regressions, ANOVAs, and more.
B. Procedure
1. Develop two math models; Full and reduced models.
2. Full model includes all X variables of interest.
3. Reduced model includes all X variables of
interest except the X variable(s) we want to test.
4. Example: CGPA (Y), ACT (X1), HGPA (X2), CRED
(X3).
Want to test all three Xs (whole model).
Full: y = ฮฒ0 + ฮฒ1X1 + ฮฒ2X2 + ฮฒ3X3 + ฮตi
Reduced: y = ฮฒ0 + ฮตi
(SSER-SSEF)/(dfR-dfF) SSR/p
F = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
SSEF/dfF SSE/(n-p-1)
III. Testing Overall Regression
A. Same as the ANOVA test in Ch. 8.
B. Since SSR = SSY*Rยฒ and SSE = SSY*(1-Rยฒ),
SSR/p SSY*Rยฒ/p Rยฒ/p
F = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
SSE/(n-p-1) SSY*(1-Rยฒ)/(n-p-1) (1-Rยฒ)/(n-p-1)
C. ANOVA Table (From p. 120, table 8-2)
Source df SS MS F(obs)
Model (Reg) 3 693.06 231.02 9.47
Error (Res) 8 195.19 24.40
โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
Total 11 888.25
Rยฒ = .7802
D. Model Comparison Procedure (Handout p. 2)
1. Run two Reg. models; Full and Reduced
2. Full: WGT = ฮฒ0 + ฮฒ1HGT + ฮฒ2AGE + ฮฒ3AGEยฒ + ฮตi
Reduced: WGT = ฮฒ0 + ฮตi
Docsity.com
pf3
pf4

Partial preview of the text

Download Testing Hypotheses in Multiple Regression: Model Comparison and Partial F-tests and more Study notes Statistics for Psychologists in PDF only on Docsity!

Ch. 9. Testing Hypotheses in Multiple Regression

I. Situation Testing hypotheses about a whole model, a single variable, or a group of variables.

II. Model Comparison Approach in General Linear Model A. Situation: All hypothesis testing can be viewed as a model comparison in General Linear Model which include all multiple regressions, ANOVAs, and more. B. Procedure

  1. Develop two math models; Full and reduced models.
  2. Full model includes all X variables of interest.
  3. Reduced model includes all X variables of interest except the X variable(s) we want to test.
  4. Example: CGPA (Y), ACT (X1), HGPA (X2), CRED (X3). Want to test all three Xs (whole model). Full: y = ฮฒ 0 + ฮฒ 1 X1 + ฮฒ 2 X2 + ฮฒ 3 X3 + ฮตi Reduced: y = ฮฒ 0 + ฮตi

(SSER-SSEF)/(dfR-dfF) SSR/p F = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ SSEF/dfF SSE/(n-p-1)

III. Testing Overall Regression A. Same as the ANOVA test in Ch. 8. B. Since SSR = SSYRยฒ and SSE = SSY(1-Rยฒ),

SSR/p SSYRยฒ/p Rยฒ/p F = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ SSE/(n-p-1) SSY(1-Rยฒ)/(n-p-1) (1-Rยฒ)/(n-p-1)

C. ANOVA Table (From p. 120, table 8-2)

Source df SS MS F(obs)

Model (Reg) 3 693.06 231.02 9. Error (Res) 8 195.19 24. โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ Total 11 888.

Rยฒ =. D. Model Comparison Procedure (Handout p. 2)

  1. Run two Reg. models; Full and Reduced
  2. Full: WGT = ฮฒ 0 + ฮฒ 1 HGT + ฮฒ 2 AGE + ฮฒ 3 AGEยฒ + ฮตi Reduced: WGT = ฮฒ 0 + ฮตi
  1. Compute F(obs)

(SSER-SSEF)/(dfR-dfF) SSR/p F = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ SSEF/dfF SSE/(n-p-1)

(888.25-195.19)/(11-8) 693.06/ = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ 195.19/8 195.19/

= โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ = 9.

IV. Testing significance of one additional X variable (Partial F-test, Handout pp. 3-4) A. Procedure

  1. Run two Reg. models; Full and Reduced.
  2. Full: WGT = ฮฒ 0 + ฮฒ 1 HGT + ฮฒ 2 AGE + ฮฒ 3 AGEยฒ + ฮตi Reduced: WGT = ฮฒ 0 + ฮฒ 1 HGT + ฮฒ 2 AGE + ฮตi
  3. Compute F(obs)

(SSER-SSEF)/(dfR-dfF) F = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ SSEF/dfF

(195.427-195.19)/(9-8). = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ =. 195.19/8 24.

V. Testing significance of multiple additional X variables (Multiple Partial F-test, Handout pp. 5-6) A. Procedure

  1. Run two Reg. models; Full and Reduced.
  2. Full: WGT = ฮฒ 0 + ฮฒ 1 HGT + ฮฒ 2 AGE + ฮฒ 3 AGEยฒ + ฮตi Reduced: WGT = ฮฒ 0 + ฮฒ 1 HGT + ฮตi
  3. Compute F(obs)

(SSER-SSEF)/(dfR-dfF) F = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ SSEF/dfF

(299.327-195.19)/(10-8) = โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ 195.19/

Reduced: WGT = ฮฒ 0 + ฮฒ 1 HGT + ฮฒ 3 AGEยฒ + ฮตi Obviously, we eliminated all other variables.

  1. The third test for AGEยฒ. Full: WGT = ฮฒ 0 + ฮฒ 1 HGT + ฮฒ 2 AGE + ฮฒ 3 AGEยฒ + ฮตi Reduced: WGT = ฮฒ 0 + ฮฒ 1 HGT + ฮฒ 2 AGE + ฮตi Obviously, we eliminated all other variables.
  2. This type of tests does not depend on the order of variables entered in the model. D. There are four (4) different Types of SS, Type I - IV.
  3. Type II is identical to Type III except Type II does not have Interaction Effect.
  4. Type IV is identical to Type III except Type IV is for the case where we have some empty cells.
  5. Notice that I used PROC GLM instead of PROC REG.
  6. You may hold your curiosity for a while until 6290/7290.