WLS - Mathematics and Statistics - Study Notes, Study notes of Mathematical Statistics

This document has following main points WLS, Model, Computational Details, Regression, ANOVA table, Algorithm, Function of model

Typology: Study notes

2011/2012

Uploaded on 10/31/2012

sangawar
sangawar 🇮🇳

4.5

(4)

118 documents

1 / 2

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
1
WLS
WLS estimates regression model with different weights for different cases.
Notation
The following notation is used throughout this chapter unless otherwise stated:
n The number of cases
p The number of parameters for the model
y n1 vector with element yi, which represents the observed
dependent variable for case i
X np matrix with element xij , which represents the observed
value of the ith case of the jth independent variable
β p1 vector with element
β
j, which represents the regression
coefficient of the jth independent variable
w n1 vector with element wi, which represents the weight for
case i
Model
The linear regression model has the form of
yin
iii
=+ =X,,,β
ε
1K 1
16
where Xi is the vector of covariates for the ith case, E
ε
i
16
=0, and
var
εσ
ii
w
16
=12
. Assuming that
εε
1,,Kn follow a normal distribution, the log-
likelihood function of model (1) is
pf2

Partial preview of the text

Download WLS - Mathematics and Statistics - Study Notes and more Study notes Mathematical Statistics in PDF only on Docsity!

1

WLS

WLS estimates regression model with different weights for different cases.

Notation

The following notation is used throughout this chapter unless otherwise stated:

n (^) The number of cases p (^) The number of parameters for the model y (^) n ô 1 vector with element y i , which represents the observed dependent variable for case i X (^) n ô p matrix with element xij , which represents the observed value of the i th case of the j th independent variable β p^ ô^1 vector with element^ β^ j , which represents the regression coefficient of the j th independent variable w (^) n ô 1 vector with element wi , which represents the weight for case i

Model

The linear regression model has the form of

y i = X i ’^ β+ ε i , i = 1 , K , n 1 6 1

where X i is the vector of covariates for the i th case, E 1 6 ε i = 0 , and

var1 6 ε i = wi −^1 σ^2. Assuming that ε 1 , K, ε n follow a normal distribution, the log-

likelihood function of model (1) is

2 WLS

2

L n n w

w y

i i

n i^ i^ i i

n

K

K

K

K

K

K

K

K

=

1

2

1

. ln ln ln 2

π σ σ

4^ X^ β 9

Computational Details

The algorithm used to obtain the weighted least-square estimates for the parameters in the model is the same as the REGRESSION procedure with regression weight. For details of the algorithm and statistics (the ANOVA table and the variables in the equation), see REGRESSION. After the estimation is finished, the log-likelihood function shown in (2) is estimated by

L^ $^. n ln n ln $^ ln w n p i i

n = − − + − −

K

'K

K

= *K

2 1

where σ$ 2 is the mean square error in the ANOVA table.