Probability and Statistics Solutions for ECE 313 - University of Illinois Spring 2008, Assignments of Statistics

Solutions to problem set 5 of ece 313 course offered at the university of illinois in spring 2008. It covers various probability and statistics concepts including binomial and negative binomial distributions, geometric random variables, and confidence intervals.

Typology: Assignments

Pre 2010

Uploaded on 03/16/2009

koofers-user-i8x
koofers-user-i8x 🇺🇸

9 documents

1 / 3

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
University of Illinois Spring 2008
ECE 313: Solutions to Problem Set 5
1. (a) Xdenotes a binomial random variable with parameters (N, p). It counts the number of
occurrences of an event Aof probability pon Nindependent trials. Y=N X counts
the number of occurrences of Ac, an event of probability 1 p, on the Nindependent
trials and is thus a binomial random variable with parameters (N, 1p).
(b) P{X is even}=N
0p0(1 p)N+N
2p2(1 p)N2+N
4p4(1 p)N4+···
Now, from the binomial theorem (Ross, page 8) we get that
(x+y)N+ (x+y)N= 2hN
0x0yN+N
2x2yN2+N
4p4(1 p)N4+···i, and so,
setting x=p, y = 1 p, we get P{X is even}=1
2(p+ 1 p)N+ (p+ 1 p)N=
1
21 + (1 2p)N.Notice that the probability is 1/2 for p= 1/2, 1 for p= 0, and 1 (or
0) for p= 1 according as Nis even or odd.
2. (a) P{Y is even}=P{Y = 0}+P{Y = 2}+P{Y = 4}+· ·· = exp(λ)h1 + λ2
2! +λ4
4! +···i
= exp(λ) cosh(λ) by recognizing the series in square brackets.
(b) 1
21 + (1 2p)N=1
2h1 + 12λ
NNi1
2[1 + exp(2λ)] = exp(λ)exp(λ)+exp(λ)
2
= exp(λ) cosh(λ).
(c) For fixed Y=k, the likelihood function (parameterized by θ) is L(θ;k) = θkeθ
k!.To
find the ML estimate of λ, we find ˆ
θthat maximizes L(θ;k). Setting the derivative of
L(θ;k) equal to zero, we get
∂L(θ;k)
∂θ =1
k!hk1eθ+θkeθ(1)i=θk1eθ
k![kθ]=0 ˆ
θML =k.
3. (a) On average, E[X] = 105 ×0.9 = 94.5 passengers show up for the flight.
(b)
P{X 100}= 1 P{X >100}= 1
105
X
k=101
P{X =k}
= 1 105
101(0.9)101(0.1)4105
102(0.9)102(0.1)3105
103(0.9)103(0.1)2
105
104(0.9)104(0.1)1105
105(0.9)105(0.1)0
= 1 105
4(0.9)101(0.1)4105
3(0.9)102(0.1)3105
2(0.9)103(0.1)2
105
1(0.9)104(0.1)1105
0(0.9)105(0.1)0
= 0.9832 . . .
(c) We saw earlier that if Xis a binomial random variable with parameters (n, p), then
Y=n X is a binomial random variable with parameters (n, 1p).
(d) P{Y 5}= 1 P{Y = 0} P{Y = 1} P{Y = 2} P{Y = 3} P{Y = 4}=
1exp(10.5) h1 + 10.5
1! +(10.5)2
2! +(10.5)3
3! +(10.5)4
4! i= 0.9789 . . . .
pf3

Partial preview of the text

Download Probability and Statistics Solutions for ECE 313 - University of Illinois Spring 2008 and more Assignments Statistics in PDF only on Docsity!

University of Illinois Spring 2008

ECE 313: Solutions to Problem Set 5

  1. (a) X denotes a binomial random variable with parameters (N, p). It counts the number of occurrences of an event A of probability p on N independent trials. Y = N − X counts the number of occurrences of Ac, an event of probability 1 − p, on the N independent trials and is thus a binomial random variable with parameters (N, 1 − p).

(b) P {X is even} =

N

p^0 (1 − p)N^ +

N

p^2 (1 − p)N^ −^2 +

N

p^4 (1 − p)N^ −^4 + · · · Now, from the binomial theorem (Ross, page 8) we get that (x + y)N^ + (−x + y)N^ = 2

[(

N 0

x^0 yN^ +

(N

2

x^2 yN^ −^2 +

(N

4

p^4 (1 − p)N^ −^4 + · · ·

]

, and so, setting x = p, y = 1 − p, we get P {X is even} = (^12)

[

(p + 1 − p)N^ + (−p + 1 − p)N^

]

1 2

[

1 + (1 − 2 p)N^

]

. Notice that the probability is 1/2 for p = 1/2, 1 for p = 0, and 1 (or

  1. for p = 1 according as N is even or odd.
  1. (a) P {Y is even} = P {Y = 0} + P {Y = 2} + P {Y = 4} + · · · = exp(−λ)

[

1 + λ 2!^2 + λ 4!^4 + · · ·

]

= exp(−λ) cosh(λ) by recognizing the series in square brackets. (b) (^12)

[

1 + (1 − 2 p)N^

]

[

1 − (^2) Nλ

)N ]

→ 12 [1 + exp(− 2 λ)] = exp(−λ) exp(λ)+exp( 2 −λ) = exp(−λ) cosh(λ).

(c) For fixed Y = k, the likelihood function (parameterized by θ) is L(θ; k) = θ

ke−θ k!.^ To find the ML estimate of λ, we find θˆ that maximizes L(θ; k). Setting the derivative of L(θ; k) equal to zero, we get ∂L(θ; k) ∂θ

=^1

k!

[

kθk−^1 e−θ^ + θke−θ(−1)

]

= θ

k− (^1) e−θ k!

[k − θ] = 0 ⇒ θˆM L = k.

  1. (a) On average, E[X ] = 105 × 0 .9 = 94.5 passengers show up for the flight. (b)

P {X ≤ 100 } = 1 − P {X > 100 } = 1 −

∑^105

k=

P {X = k}

(0.9)^101 (0.1)^4 −

(0.9)^102 (0.1)^3 −

(0.9)^103 (0.1)^2

(0.9)^104 (0.1)^1 −

(0.9)^105 (0.1)^0

(0.9)^101 (0.1)^4 −

(0.9)^102 (0.1)^3 −

(0.9)^103 (0.1)^2

(0.9)^104 (0.1)^1 −

(0.9)^105 (0.1)^0

(c) We saw earlier that if X is a binomial random variable with parameters (n, p), then Y = n − X is a binomial random variable with parameters (n, 1 − p). (d) P {Y ≥ 5 } = 1 − P {Y = 0} − P {Y = 1} − P {Y = 2} − P {Y = 3} − P {Y = 4} = 1 − exp(− 10 .5)

[

1 + 10 1!.^5 + (10.5)

2 2! +^

(10.5)^3 3! +^

(10.5)^4 4!

]

  1. (a) At least two boxes of Cornies must be bought.

(b) For k ≥ 2, P {X = k} = P (HH · · · HB)+P (BB · · · BH) =

)k− 1

)k− 1 .

E[X ] =

∑^ ∞

k=

k ·

[(

)k− 1

)k− 1 ]

∑^ ∞

k=

k ·

[(

)k− 1

)k− 1 ] − 1 3

=^3

+^3

− 1 = 3^1

It is instructive to do this problem via conditional probabilities. Conditioned on the first box being an H, we are waiting for a B, an event of probability 13 to occur. On average, an additional 3 boxes must be bought.. Conditioned on the first box being a B, we are waiting for an H, an event of probability 23 to occur. On average, an additional 1. 5 boxes must be bought. Hence,

E[X ] = (1 + 3)P (H) + (1 + 1.5)P (B) = 4 ·

= 3^1

(c) Now, Mrs Kirk buys W ≥ 4 boxes of Cornies. Consider the contents of the first two boxes.

  • If the first two boxes have given Jimmy one H and one K (this has probability 49 ), then in effect he has been transported back in time to the previous year since he now just has to collect one H and one K. Thus, conditioned on the first two boxes having an H and a K, W = 2 + X where X was discussed in parts (a) and (b).
  • If the first two boxes give Jimmy two H’s (probability 49 ) or two K’s (probability 1 9 ), then he has to wait for two^ K’s (or two^ H’s) to occur. Conditioned on this event HH (or KK), W = 2 + V where V is a negative binomial random variable with parameters (2, 13 ) (or (2, 23 )) and mean 6 (or 3). Hence, for k ≥ 4, P {W = k} = P {X = k − 2 } 4 9
  • P {V = k − 2 } 4 9

  • P {V = k − 2 } 1 9

=

[(

)k− 3

)k− 3 ] 4 9 +

[

(k − 3)

)k− 4 ] 4 9 +

[

(k − 3)

)k− 4 ] 1 9

which simplifies to P {W = k} =

(2k−^2 + 4)(k − 1) 3 k^.^ Computing^ E[W] from this result is messy. It is much easier to compute E[W] via conditional probabilities. If the first two boxes give Jimmy a H and a K, his mother has to buy 3.5 more boxes on average. If he gets HH, 6 more boxes are needed on average, while if he gets KK, 3 more boxes are needed on average. Hence,

E[W] = 2 +

× 4

+ 6 × 4

+ 3 × 1

= 6^5

  1. (a) Assuming that the CRC detects all errors (which is not strictly true), the probability that the CRC indicates no error in a received packet is just (1 − p)N^ , the probability that all N bits were received correctly. (b) P {packet lost} = P {packet in error 5 times} = (1 − (1 − p)N^ )^5 and hence P {packet is received successfully} = 1 − (1 − (1 − p)N^ )^5 = 5(1 − p)N^ − 10(1 − p)^2 N^ + 10(1 − p)^3 N^ − 5(1 − p)^4 N^ + (1 − p)^5 N^.