Generalized Linear Model - Lecture Notes | ST 762, Study notes of Statistics

Generalized Linear Model Material Type: Notes; Professor: Bloomfield; Class: Nonlinear Statistical Models for Univariate and Multivariate Response; Subject: Statistics; University: North Carolina State University; Term: Unknown 1989;

Typology: Study notes

Pre 2010

Uploaded on 03/10/2009

koofers-user-lm6
koofers-user-lm6 🇺🇸

5

(1)

10 documents

1 / 10

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Generalized Linear Model
Certain nonlinear models with a specific structure arise from
using linear modeling with a parent distribution in the expo-
nential family.
If the linear part is replaced by a more general nonlinear
specification, the result is a special case of our general mean-
variance specification
E(Y|x) = f(x,β),
var(Y|x) = σ2g(β,θ,x)2.
Estimation may also be carried out using the GLS estimation
equations.
1
pf3
pf4
pf5
pf8
pf9
pfa

Partial preview of the text

Download Generalized Linear Model - Lecture Notes | ST 762 and more Study notes Statistics in PDF only on Docsity!

Generalized Linear Model

  • Certain nonlinear models with a specific structure arise from using linear modeling with a parent distribution in the expo- nential family.
  • If the linear part is replaced by a more general nonlinear specification, the result is a special case of our general mean- variance specification

E(Y |x) = f (x, β),

var(Y |x) = σ^2 g(β, θ, x)^2.

  • Estimation may also be carried out using the GLS estimation equations.

The (Scaled) Exponential Family

  • Y has a scaled exponential family distribution if its density (or probability mass function) is of the form

f (y; ξ, σ) = exp

{ yξ − b(ξ) σ^2

  • c(y, σ)

} .

  • ξ is the canonical parameter, and σ is the scale parameter.
  • If σ^2 is known, this is the usual one-parameter exponential family with canonical parameter ξ.
  • If σ^2 is unknown, it may or may not be the usual two- parameter exponential family.
  • Also

var(Y ) = σ^2 bξξ

( b− ξ 1 (μ)

) = σ^2 g(μ)^2 ,

so the variance depends on the mean in a specific way.

  • Examples of the scaled exponential family:

Distribution b(ξ) ξ(μ) g(μ)^2

Normal, σ^2 = 1 ξ^2 / 2 μ 1 Poisson exp(ξ) log μ μ Gamma − log(−ξ) 1 /μ μ^2 Inverse Gaussian −

− 2 ξ 1 /μ^2 μ^3 Binomial log

( 1 + eξ

) log (^1) −μμ μ(1 − μ)

Sufficiency

  • If Y 1 , Y 2 ,... , Yn is a random sample from a member of this family, the log-likelihood is

log L =

∑^ n

j=

[ Yjξ − b(ξ) σ^2

  • c(Yj, σ)

]

σ^2

 ξ

∑^ n

j=

Yj − nb(ξ)

  (^) +

∑^ n

j=

c

( Yj, σ

)

so (if σ^2 is known)

∑ Yj is sufficient for ξ.

  • Note that bξ(·) is determined by the distribution.
  • We can replace it by a different function

E

( Yj

∣∣

∣ xj

) = f

(

xTj β

) ,

and it is still called a generalized linear model.

  • Because the link f −^1 (·) is no longer the canonical link, we

lose sufficiency–not a big deal.

  • R and SAS support fitting these models with the link function

chosen from a list.

Example: Six Cities Wheezing data

  • Response: child wheezes at age 9 (0 or 1).
  • Predictor: mother’s smoking status (0 = none, 1 = moder- ate, 2 = heavy).
  • Possible covariate: community (Portage or Kingston).

Generalized Nonlinear Model

  • We may want a more general specification for the conditional mean: E

( Yj

∣∣

∣xj

) = f

(

xj, β

) .

  • This is consistent with the scaled exponential family if ξj satisfies bξ

( ξj

) = f

(

xj, β

) .

  • The mean-variance relationship is still determined by the dis- tribution:

var

( Yj

∣∣

∣xj

) = σ^2 g

{ E

( Yj

∣∣

∣xj

)} 2 = σ^2 g

{ f

(

xj, β

)} 2 .