

Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
Multiple regression analysis, a statistical method used to establish a linear function to predict a dependent variable (y) based on multiple independent variables (x1, x2, ..., xp). It covers the population and sample regression models, assumptions, and model testing using an anova table.
Typology: Study notes
1 / 2
This page cannot be seen from the preview
Don't miss anything!


Ch. 8. Multiple Regression
I. Situation A. Have more than one X variable. B. Want to establish a linear function to predict Y using the linear combination of all X variables of interest.
II. Model A. In the population yi = β 0 + β 1 xi1 + β 2 xi2 +... + βpxip + εi where, β 0 - βp : regression coefficients, xi1 - xip : predictor variables, and εi : error associated with the prediction.
y ˆ^ i = μY|X1,X2,...,Xp = β 0 + β 1 xi + β 2 xi2 +... + βpxip where (^) y ˆ (^) i : predicted value of y.
Thus, yi = β 0 + β 1 xi + β 2 xi2 +... + βpxip + εi = y ˆ^ i + εi and, εi = yi - y ˆ (^) i
B. Sample Regression Model
yi = b 0 + b 1 xi1 + b 2 xi2 +... + bpxip + ei
y ˆ (^) i = b 0 + b 1 xi1 + b 2 xi2 +... + bpxip
ei = yi - y ˆ (^) i
III. Assumptions A. Assumption 1: Existence For a given value of y ˆ^ , y has a certain (usually normal) distribution with a finite mean (μY|X1,X2,...,Xp) and variance (σ²Y|X1,X2,...,Xp). B. Assumption 2: Independence For a given value of y ˆ , y is independently
distributed. C. Assumption 3: Linearity The mean values of y for a given y ˆ make a straight- line function with the y ˆ values. D. Assumption 4: Homoscedasticity The variance of y-score distribution is the same
across all given y ˆ^ values.
σ²Y|X1,X2,...,Xp ≡ σ² E. Assumption 5: Normal Distribution For each given y ˆ^ value the y scores are normally distributed. Y ∩ N(μY|X1,X2,...,Xp,σ²) F. Assumption 6: Error-free Measurement of X's The x's are measured without measurement error.
III. Model Testing: Testing if the model as a whole is a significant predictor of Y.
A. ANOVA Table
Source df SS MS F(obs)
Model (Reg) p SSR SSR/p MSR/MSE Error (Res) n-p-1 SSE SSE/(n-p-1) ────────────────────────────────────── Total n-1 SSY
B. Notes If F(obs) ≥ F(crit) [α=.05 or.01, df(num)=p, df(den)=n-p-1], then reject Ho.