10 Questions on Probability - Statistics Assignment | STAT 430, Assignments of Statistics

Material Type: Assignment; Class: PROBABILITY; Subject: Statistics; University: University of Pennsylvania; Term: Spring 2003;

Typology: Assignments

Pre 2010

Uploaded on 03/28/2010

koofers-user-rge
koofers-user-rge 🇺🇸

10 documents

1 / 2

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Statistics 430
Assignment
Due April 3
This homework assignment considers another use of the central limit theorem. First, it will lead you
through the derivation, one that is quite similar to the one done in class. Second, you’ll use the resulting
normal approximation.
Throughout this assignment, the random variable Xdenotes a Poisson random variable with parameter
λand PMF given by
p(x) = eλλx
x!, x = 0,1, . . .
We’ll consider what happens to this density as λ . To keep the algebra manageable, assume that λis
an integer.
1. Show (for integer valued λ > 0) that the peak (mode) of the Poisson density is at λ1 and at λ. That
is, show that p(λ1) = p(λ) and that the common value is the maximum of p(x). (Hint: Look at the
ratio of p(x)/p(x1) for xnear λ.)
2. Show that we can write the ratio of probability at λ+x(for x > 0) to the probability at the mode
(which is also the mean) λas the following sum:
p(λ+x)
p(λ)=p(λ+x)
p(λ+x1)
p(λ+x1)
p(λ+x2) ··· p(λ+ 1)
p(λ).(1)
3. Show that a typical ratio in the product (1) has the form
p(j)
p(j1) =λ
j.
4. Combine the results of the previous two steps to show that the log of the big product in (1) can be
written as the sum
log p(λ+x)
p(λ)=
x
X
j=1
log(1 + j/λ).(2)
5. Approximate the sum in (2) using log(1 + )for “close” to zero. Also approximate the sum of
the first xintegers as Px
j=1 jx2/2, arriving at
log p(λ+x)
p(λ) x2
2λ.(3)
6. Because of the use of the approximation to the log in the prior step, under what conditions (i.e., for
what values of x) will the approximation in equation (3) be useful?
7. A very famous approximation for the factorial finishes up the derivation. The approximation is known
as Stirling’s formula, given by (for positive integers)
j!jjejp2πj . (4)
Compare Stirling’s approximation for j! to the exact value for j= 5,10,20, and 50. How accurate is
the approximation?
pf2

Partial preview of the text

Download 10 Questions on Probability - Statistics Assignment | STAT 430 and more Assignments Statistics in PDF only on Docsity!

Statistics 430

Assignment

Due April 3

This homework assignment considers another use of the central limit theorem. First, it will lead you through the derivation, one that is quite similar to the one done in class. Second, you’ll use the resulting normal approximation.

Throughout this assignment, the random variable X denotes a Poisson random variable with parameter λ and PMF given by p(x) = e

−λλx x! ,^ x^ = 0,^1 ,... We’ll consider what happens to this density as λ → ∞. To keep the algebra manageable, assume that λ is an integer.

  1. Show (for integer valued λ > 0) that the peak (mode) of the Poisson density is at λ − 1 and at λ. That is, show that p(λ − 1) = p(λ) and that the common value is the maximum of p(x). (Hint: Look at the ratio of p(x)/p(x − 1) for x near λ.)
  2. Show that we can write the ratio of probability at λ + x (for x > 0) to the probability at the mode (which is also the mean) λ as the following sum: p(λ + x) p(λ) =^

p(λ + x) p(λ + x − 1)

p(λ + x − 1) p(λ + x − 2) · · ·^

p(λ + 1) p(λ).^ (1)

  1. Show that a typical ratio in the product (1) has the form p(j) p(j − 1) =^

λ j.

  1. Combine the results of the previous two steps to show that the log of the big product in (1) can be written as the sum log p(λ p^ (+λ)^ x )= −

∑^ x j=

log(1 + j/λ). (2)

  1. Approximate the sum in (2) using log(1 + ) ≈  for  “close” to zero. Also approximate the sum of the first x integers as ∑xj=1 j ≈ x^2 /2, arriving at

log p(λ p^ (+λ)^ x )≈ − x

2 2 λ.^ (3)

  1. Because of the use of the approximation to the log in the prior step, under what conditions (i.e., for what values of x) will the approximation in equation (3) be useful?
  2. A very famous approximation for the factorial finishes up the derivation. The approximation is known as Stirling’s formula, given by (for positive integers) j! ≈ jj^ e−j^ √ 2 πj. (4) Compare Stirling’s approximation for j! to the exact value for j = 5, 10 , 20, and 50. How accurate is the approximation?
  1. Substitute Stirling’s approximation (4) for the factorial in p(λ) to show that

p(λ + x) ≈ e

−x^2 /(2λ) √ 2 πλ. (5)

  1. (a) Suppose that X ∼ Poisson(4). Compare the normal approximation given by (5) for P (X = 6) to the exact probability given by the Poisson PMF. (b) Repeat (a), but with λ = 9 and P (X = 12). (c) Repeat (a), but with λ = 36 and P (X = 42). (d) Repeat (a), but with λ = 100 and P (X = 110).
  2. The bell-shaped normal distribution can be attributed to combining or adding together many small influences. Along these lines, explain why the normal approximation whould “work” in the sense of approximating Poisson probabilities.