Problem Set # 14 Solutions for ECE 313 - Fall 2002, Assignments of Statistics

Solutions to problem set # 14 for the electrical and computer engineering (ece) 313 course, focusing on topics such as correlation of histogram values, conditional expectation of histogram values, covariance for a poisson process, conditional expectation for uniform density over a triangle, and other related probability concepts.

Typology: Assignments

Pre 2010

Uploaded on 02/24/2010

koofers-user-pk3
koofers-user-pk3 🇺🇸

10 documents

1 / 2

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
ECE 313 Problem Set # 14 Solutions Fall 2002
1. Correlation of histogram values
(a) X1is Bernoulli with parameter p=1
6, so E[X1] = 1
6and V ar(X1) = 1
6(1 1
6) = 5
36 .
(b) E[X] = nE[X1] = n
6and V ar(X) = nV ar(X1) = 5n
36 .
(c) We begin by computing Cov(X1, Y1). Since X1Y1= 0 with probability one, E[X1Y1] = 0.
Therefore Cov(X1, Y1) = E[X1Y1]E[X1]E[Y1] = 0 1
6
1
6=1
36 . So Cov(Xi, Yi) = 1
36 for any i.
On the other hand, if i6=jthen Xiis independent of Xj. So
Cov(Xi, Yj) = (1
36 if i=j
0 if i6=j
(d)
Cov(X, Y ) = X
iX
j
Cov(Xi, Yj) = X
i
Cov(Xi, Yi) = nCov(X1, Y1) = n
36
and
ρ(X, Y ) = Cov(X, Y )
pV ar(X)V ar(Y)=1
5
2. Conditional expectation of histogram values
(a) Given that xof the dice show a 1, each of the remaining dice is equally likely to show 2,3,4,5,
or 6. Thus, each of the remaining nxdice shows a 2 with conditional probability 1
5. Therefore
E[Y|X=x] = nx
5.
(b) This is the same function found in part (a) by general theory. That is, g(x) = E[Y|X=x] =
nx
5.
3. Covariance for a Poisson process
(a) As found in Problem 3(d) of Problem Set 10, the conditional distribution of N(τ) given N(T) =
nis binomial with parameters nand p=τ
T. Therefore E[N(τ)|N(T) = n] =
T.
(b) As found in Problem 3(e) of Problem Set 10, the conditional distribution of N(T) given N(τ) = i
is the same as the distribution of iplus a Poisson random variable with mean (Tτ)λ. Therefore
E[N(T)|N(τ) = i] = i+ (Tτ)λ.
(c) Since N(τ) is a Poisson random variable with mean λτ, and since the variance of a Poisson
random variable is the same as the mean, Cov(N(τ), N (τ)) = V ar(N(τ)) = λτ .
(d) Since N(τ) is independent of N(T)N(τ), Cov(N(τ), N (T)N(τ)) = 0.
(e) Use N(T) = N(τ) + (N(T)N(τ)) to get Cov(N(τ), N (T)) = Cov(N τ ), N (τ) + (N(T)
N(τ))) = Cov(N(τ), N (τ)) + Cov(N(τ),(N(T)N(τ))) = λτ + 0 = λτ.
4. Conditional expectation for uniform density over a triangle
(a) The triangle has base and height one, so the area of the triangle is 0.5. Thus the joint pdf is 2
inside the triangle.
(b)
fX(x) = Z
−∞
fXY (x, y )dy =
Rx/2
02dy =xif 0 <x<1
Rx/2
x12dy = 2 xif 1 <x<2
0 else
(c) In view of part (c), the conditional density fY|X(y|x) is not well defined unless 0 < x < 2. In
pf2

Partial preview of the text

Download Problem Set # 14 Solutions for ECE 313 - Fall 2002 and more Assignments Statistics in PDF only on Docsity!

ECE 313 Problem Set # 14 Solutions Fall 2002

  1. Correlation of histogram values (a) X 1 is Bernoulli with parameter p = 16 , so E[X 1 ] = 16 and V ar(X 1 ) = 16 (1 − 16 ) = 365. (b) E[X] = nE[X 1 ] = n 6 and V ar(X) = nV ar(X 1 ) = 536 n. (c) We begin by computing Cov(X 1 , Y 1 ). Since X 1 Y 1 = 0 with probability one, E[X 1 Y 1 ] = 0. Therefore Cov(X 1 , Y 1 ) = E[X 1 Y 1 ] − E[X 1 ]E[Y 1 ] = 0 − 1616 = − 361. So Cov(Xi, Yi) = − 361 for any i. On the other hand, if i 6 = j then Xi is independent of Xj. So

Cov(Xi, Yj ) =

{ (^) − 1 36 if^ i^ =^ j 0 if i 6 = j

(d)

Cov(X, Y ) =

i

j

Cov(Xi, Yj ) =

i

Cov(Xi, Yi) = nCov(X 1 , Y 1 ) =

−n 36

and

ρ(X, Y ) =

Cov(X, Y ) √ V ar(X)V ar(Y )

  1. Conditional expectation of histogram values (a) Given that x of the dice show a 1, each of the remaining dice is equally likely to show 2,3,4,5, or 6. Thus, each of the remaining n − x dice shows a 2 with conditional probability 15. Therefore E[Y |X = x] = n− 5 x. (b) This is the same function found in part (a) by general theory. That is, g(x) = E[Y |X = x] = n−x 5.
  2. Covariance for a Poisson process (a) As found in Problem 3(d) of Problem Set 10, the conditional distribution of N (τ ) given N (T ) = n is binomial with parameters n and p = (^) Tτ. Therefore E[N (τ )|N (T ) = n] = nτ T. (b) As found in Problem 3(e) of Problem Set 10, the conditional distribution of N (T ) given N (τ ) = i is the same as the distribution of i plus a Poisson random variable with mean (T − τ )λ. Therefore E[N (T )|N (τ ) = i] = i + (T − τ )λ. (c) Since N (τ ) is a Poisson random variable with mean λτ , and since the variance of a Poisson random variable is the same as the mean, Cov(N (τ ), N (τ )) = V ar(N (τ )) = λτ. (d) Since N (τ ) is independent of N (T ) − N (τ ), Cov(N (τ ), N (T ) − N (τ )) = 0. (e) Use N (T ) = N (τ ) + (N (T ) − N (τ )) to get Cov(N (τ ), N (T )) = Cov(N τ ), N (τ ) + (N (T ) − N (τ ))) = Cov(N (τ ), N (τ )) + Cov(N (τ ), (N (T ) − N (τ ))) = λτ + 0 = λτ.
  3. Conditional expectation for uniform density over a triangle (a) The triangle has base and height one, so the area of the triangle is 0.5. Thus the joint pdf is 2 inside the triangle. (b)

fX (x) =

∫ (^) ∞

−∞

fXY (x, y)dy =

 



∫ (^) x/ 2 ∫ 0 2 dy^ =^ x^ if 0^ < x <^1 x/ 2 x− 1 2 dy^ = 2^ −^ x^ if 1^ < x <^2 0 else

(c) In view of part (c), the conditional density fY |X (y|x) is not well defined unless 0 < x < 2. In

general we have

fY |X (y|x) =

  

 

2 x if 0^ < x^ ≤^ 1 and^ y^ ∈^ [0,^

x 2 ] 0 if 0 < x ≤ 1 and y 6 ∈ [0, x 2 ] 2 2 −x if 1^ < x <^ 2 and^ y^ ∈^ [x^ −^1 ,^

x 2 ] 0 if 1 < x < 2 and y 6 ∈ [x − 1 , x 2 ] not defined if x ≤ 0 or x ≥ 2

Thus, for 0 < x ≤ 1, the conditional distribution of Y is uniform over the interval [0, x 2 ]. For 1 < x ≤ 2, the conditional distribution of Y is uniform over the interval [x − 1 , x 2 ]. (d) Finding the midpoints of the intervals that Y is conditionally uniformly distributed over, or integrating x against the conditional density found in part (c), yields:

E[Y |X = x] =

 



x 3 x^4 −^2 if 0^ < x^ ≤^1 4 if 1^ < x <^2 not defined if x ≤ 0 or x ≥ 2

  1. Rock and roll (a) N is the number of independent trials until a success, and the probability of a success for each

trial is 16. Thus, N has the geometric distribution with parameter p = 16. Thus, pN (n) = 56 n−1 1 6 for n = 1, 2 , 3 ,... and pN (n) = 0 for other values of n. As seen on Ross, page 159: E[N ] = 6, and V ar(N ) = (^1) p− 2 p = 30.

(b) Given N = n, S is one more than the sum of n − 1 random variables Y 1 ,... , Yn− 1 that are independent and take the values 2,3,4,5, or 6 each with probability 15. The conditional mean of each of these n − 1 variables is 4, so that E[S|N = n] = 1 + 4(n − 1). (c) E[S] = E[E[S|N ]] = E[1 + 4(N − 1)] = 1 + 4E[N ] − 4 = 21. Imagine rolling a die repeatedly without stopping. By the law of large numbers, the frequency of each of the six numbers is the same. Thus, on average, between each two appearances of a 1, any other given number should appear an average of one time.

  1. Normal approximation for quantization error The mean of each roundoff error is zero and the variance is

∫ (^0). 5 − 0. 5 u

(^2) du = 1

  1. Thus,^ E[S] = 0 and V ar(S) = 10012 = 8.333. Thus, P [|S| ≥ 5] = P [| √ 8 S. 333 | ≥ √ 85. 333 ] ≈ 2 Q( √ 85. 333 ) = 2Q(1.73) =

2(1 − Φ(1.732)) = 0.083.

  1. A comparison of bounds and the normal approximation (a) E[X 1 ] = 1+2+3+4+5+6 6 = 3.5 so by Markov’s inequality, P [S 100 ≥ 400] ≤ 100(3 400. 5)= 78. (Not at all a strong bound.)

(b) E[X^21 ] = 1

(^2) +2 (^2) +3 (^2) +4 (^2) +5 (^2) +6 2 6 = 15 so that^ V ar(Xi) = 15^ −^3.^5

(^2) = 2.75 Therefore by Chebyshev’s

inequality P [S 100 ≥ 400] = P [S 100 − 350 ≥ 50] ≤ P [|S 100 − 350 | ≥ 50] ≤ 100(2 502 .75) = 0. 11 Or, we could use the one-side Chebyshev inequality found on page 418 of Ross. That yields P [S 100 ≥ 400] = P [S 100 − 350 ≥ 50] ≤ (^) 275+2500^275 = 0.991. (Either answer is acceptable.) (c) The normal approximation based on the central limit theorem yields

P [S 100 ≥ 400] = P [

S 100 − 350

√ (2.75)

√ (2.75)

] ≈ Q(

√ (2.75)

) = Q(3.015) = 1−Φ(3.015) ≈ 0. 0009