Quiz 5: Sufficient Statistic & Minimum Variance Estimator for Normal Distribution, Exercises of Analytical Techniques

The fifth quiz for the ece s-510 course, focusing on the concept of sufficient statistics and minimum variance unbiased estimators for a normal distribution. Students are required to find the sufficient statistic t(x1, x2, …, xn) associated with the parameter µ, its probability density function p(t(x1, x2, …, xn)|µ), and the probability density function p(x1, x2, …, xn|t(x1, x2, …, xn), µ). Additionally, students must find a minimum variance unbiased estimator for µ and demonstrate the derivation. The document also includes the probability density function of a normally distributed n-d vector x.

Typology: Exercises

2012/2013

Uploaded on 05/18/2013

maazi
maazi 🇮🇳

4.4

(12)

75 documents

1 / 1

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Name:
Winter 2006 Quiz # 5 ECE S-510
You are given a set of N independent identically distributed random variables x1, x2, ….,
xN, from the distribution
η(µ,1)
.
(a) Show that the sufficient statistic associated with the parameter
µ
is T(x1, x2, …., xN)
=
=
N
ii
x
1
and find its probability density function p(T(x1, x2, …., xN)|
µ
).
(b) Find p(x1, x2, …., xN|T(x1, x2, …., xN),
µ
). What do you observe about p(x1, x2, ….,
xN|T(x1, x2, …., xN),
µ
)? How would you go about generating a set of realizations of
x1, x2, …., xN without knowledge of
µ
?
(c) Find a minimum variance unbiased estimator for
µ
and show how you got it.
Fact: If X = ( x1, x2, …., xN) is a N-D vector which is normally distributed with mean
µ
1
and covariance matrix
[Σ] = σ
2[Ι]
, then p(X) =
2
2
)2(
1
N
πσ
exp{-
2
2
1
σ
2
1
)
(
µ
=
n
ii
x
}
___________________________________________________________
Docsity.com

Partial preview of the text

Download Quiz 5: Sufficient Statistic & Minimum Variance Estimator for Normal Distribution and more Exercises Analytical Techniques in PDF only on Docsity!

Name:

Winter 2006 Quiz # 5 ECE S-

You are given a set of N independent identically distributed random variables x 1 , x 2 , ….,

xN, from the distribution η(μ,1).

(a) Show that the sufficient statistic associated with the parameter μ is T(x 1 , x 2 , …., xN)

=

N

i

xi 1

and find its probability density function p(T(x 1 , x 2 , …., xN)| μ).

(b) Find p(x 1 , x 2 , …., xN|T(x 1 , x 2 , …., xN), μ). What do you observe about p(x 1 , x 2 , ….,

xN|T(x 1 , x 2 , …., xN), μ)? How would you go about generating a set of realizations of

x 1 , x 2 , …., xN without knowledge of μ?

(c) Find a minimum variance unbiased estimator for μ and show how you got it.

Fact: If X = ( x 1 , x 2 , …., xN ) is a N-D vector which is normally distributed with mean

μ1 and covariance matrix [Σ] = σ^2 [Ι], then p( X ) =

( 2 2 )^2

N

exp { - 2

2 1

∑( −^ μ)

=

n

i

xi }

___________________________________________________________

Docsity.com