STAT 583 Spring 2008: Statistical Functionals, Derivatives, Influence Curves, Study notes of Statistics

Lecture notes for a university course, stat 583, offered in spring 2008. The notes cover the topics of statistical functionals, gateaux derivatives, and influence curves. The concepts of gateaux derivatives and their relationship to frechét derivatives. It also introduces the notion of influence curves and provides theorems related to their properties.

Typology: Study notes

Pre 2010

Uploaded on 03/11/2009

koofers-user-jn5
koofers-user-jn5 🇺🇸

4

(1)

10 documents

1 / 2

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
STAT 583 SPRING 2008
Lecture Notes 1
Statistical Functionals
The Gâteux derivative of a statistical functional T(F) is the limit
d1T(F;GF)=lim
0
T(F+(GF)) T(F).
If Q( ) =T(F+(GF)) has a McLaurin expansion, we get an expansion (the von
Mises expansion) of T by noting that Q(0)=T(F), Q(1)=T(G), Q'(0+)=d1T(F;GF)
etc., yielding
T(G)=T(F)+1
k!dkT(F;GF)+Rm(G).
k=1
m
We are usually particularly interested in G = Fn, and we write Rm(Fn)=Rmn.
T has a differential at F with respect to a norm
if there is a linear functional
˙
T (F;)
such that for all G
T(G)
T(F)˙
T (F;GF)=o(GF)
.
˙
T
is called the Frechét derivative of T.
Theorem 1: If T has a differential at F with respect to
, then for any G the Gâteux
derivative d
1T(F;GF)
exists and equals
˙
T (F;GF).
Theorem 2: Let T have a differential at F with respect to
. Let X1,...,Xn be observations
from F (not necessarily independent), such that n F
nF=OP(1).
Then nR
Define the influence curve of T at F by h(F;x)
=d1(F,xF),
where
x
is the cdf of
point mass at x.
Theorem 3: Suppose T has a linear derivative satisfying
(a) 0
<VarFh(F;X)<
(b) nR
Define
(T,F)=EFh(F;X)
and
2(T,F)=VarFh(F;X)
. Then
T(F
n) ~ AsN(T(F)+(T,F), 2(T,F) / n)
.
pf2

Partial preview of the text

Download STAT 583 Spring 2008: Statistical Functionals, Derivatives, Influence Curves and more Study notes Statistics in PDF only on Docsity!

STAT 583 SPRING 200 8

Lecture Notes 1

Statistical Functionals

The Gâteux derivative of a statistical functional T ( F ) is the limit

d 1

T(F;G − F) = lim

↓ 0

T (F + (G − F )) − T(F)

If (^) Q( ) = T (F + (G − F )) has a McLaurin expansion, we get an expansion (the von

Mises expansion ) of T by noting that Q (0)= T ( F ), Q (1)= T ( G ), (^) Q'(0 +) = d 1

T (F;G − F)

etc., yielding

T (G) = T (F ) +

k!

d k

T (F;G − F ) + R

m

(G).

k = 1

m

We are usually particularly interested in G = Fn , and we write Rm ( F n )=Rmn.

T has a differential at F with respect to a norm • if there is a linear functional

T (F;∆)

such that for all G

T (G) − T (F ) −

T (F;G − F) = o( G − F ).

T is called the Frechét derivative of T.

Theorem 1: If T has a differential at F with respect to (^) • , then for any G the Gâteux

derivative d 1

T(F;G − F) exists and equals

T (F;G − F ).

Theorem 2: Let T have a differential at F with respect to (^) •. Let X 1

,..., X

n be observations

from F (not necessarily independent), such that (^) n F n

− F = O

P

(1). Then^ nR 1 n

P

Define the influence curve of T at F by h(F; x) = d 1

(F,

x

− F),where x

is the cdf of

point mass at x.

Theorem 3: Suppose T has a linear derivative satisfying

(a) (^0) < Var F

h(F;X ) < ∞

(b) (^) nR 1 n

P

Define (^) (T ,F) = E F

h(F;X ) and^

2 (T ,F) = Var F

h(F; X). Then

T (F

n

) ~ AsN(T (F ) + (T,F ),

2 (T ,F) / n).

STAT 583 SPRING 200 8

Theorem 4: Assume that T has an influence curve which is identically zero, and a

bilinear second Gâteux derivative with symmetric kernel h(F;u,v) such that

(a) 0 < Var F

h(F;X 1

, X

2

(b) (^) nR 2 n

P

(c) (^) E F

(F; x, X) = 0 as a function of^ x.

Then

n(T (F n

) − T (F ))→

d 1

2 j

V

j

j = 1

where the V j are iid 1

2 -random variables, and j

is the eigenvalue of the operator

A g = (h(F: x, y)g(y)dF (y)

corresponding to the eigenfunction g j ( x ).