Assignment 5 Questions - Probability and Random Process Engineering | ECE 153, Assignments of Electrical and Electronics Engineering

Material Type: Assignment; Professor: Kim; Class: Probability&Random Process/Eng; Subject: Electrical & Computer Engineer; University: University of California - San Diego; Term: Spring 2008;

Typology: Assignments

Pre 2010

Uploaded on 03/28/2010

koofers-user-sd9
koofers-user-sd9 šŸ‡ŗšŸ‡ø

10 documents

1 / 2

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
UCSD ECE 153 Handout #18
Prof. Young-Han Kim Thursday, November 6, 2008
Homework Set #5
Due: Thursday, November 20, 2008
1. Work on the midterm problems to make sure you understand everything clearly.
2. Read Sections 6.1–6.5 in the text. Try to work on all examples.
3. Which of the following matrices can be a covariance matrix? Justify your answer either
by constructing a random vector X, as a function of the i.i.d. zero mean unit variance
random variables Z1, Z2,and Z3, with the given covariance matrix, or by establishing
a contradiction.
(a) Ā·1 2
0 2 Āø(b) Ā·2 1
1 2 ¸(c) 

111
122
123

(d) 

112
123
233


4. Given a Gaussian random vector X∼N(µ,Σ), where µ= (1 2 3)Tand
Σ = 

900
041
011

.
(a) What is P(X1+X2+ 2X3<0)?
(b) Find the joint pdf on Y=AX, where
A=Ā·1 1 āˆ’1
2āˆ’1 1 Āø.
5. Packet switching. Let N∼P(λ), i.e., Poisson with parameter λ, be the number of
packets arriving at a switch per unit time. Each packet is routed to Output Port 1
with probability pand to Output Port 2 with probability (1 āˆ’p) independent of N
and of other packets. Let Xbe the number of packets routed to Output Port 1 per
unit time. Thus X= 0 if N= 0 and X=PN
i=1 Zifor N > 0, where
Zi=½1,packet irouted to Port 1
0,packet irouted to Port 2,
and Z1, Z2, . . . , ZNare conditionally independent given N.
(a) Find the mean and variance of X.
(b) Find the pmf of X. What is the pmf of Nāˆ’X?
1
pf2

Partial preview of the text

Download Assignment 5 Questions - Probability and Random Process Engineering | ECE 153 and more Assignments Electrical and Electronics Engineering in PDF only on Docsity!

UCSD ECE 153 Handout # Prof. Young-Han Kim Thursday, November 6, 2008

Homework Set # Due: Thursday, November 20, 2008

  1. Work on the midterm problems to make sure you understand everything clearly.
  2. Read Sections 6.1–6.5 in the text. Try to work on all examples.
  3. Which of the following matrices can be a covariance matrix? Justify your answer either by constructing a random vector X, as a function of the i.i.d. zero mean unit variance random variables Z 1 , Z 2 , and Z 3 , with the given covariance matrix, or by establishing a contradiction.

(a)

[

]

(b)

[

]

(c)

 (^) (d)

  1. Given a Gaussian random vector X ∼ N (μ, Σ), where μ = (1 2 3)T^ and

(a) What is P (X 1 + X 2 + 2X 3 < 0)? (b) Find the joint pdf on Y = AX, where

A =

[

]

  1. Packet switching. Let N ∼ P(Ī»), i.e., Poisson with parameter Ī», be the number of packets arriving at a switch per unit time. Each packet is routed to Output Port 1 with probability p and to Output Port 2 with probability (1 āˆ’ p) independent of N and of other packets. Let X be the number of packets routed to Output Port 1 per unit time. Thus X = 0 if N = 0 and X =

āˆ‘N

i=1 Zi^ for^ N >^ 0, where

Zi =

1 , packet i routed to Port 1 0 , packet i routed to Port 2,

and Z 1 , Z 2 ,... , ZN are conditionally independent given N.

(a) Find the mean and variance of X. (b) Find the pmf of X. What is the pmf of N āˆ’ X?

1

  1. Estimation (from Spring 2008 final). Let X 1 and X 2 be independent identically dis- tributed random variables. Let Y = X 1 + X 2.

(a) Find E[X 1 āˆ’ X 2 |Y ]. (b) Find the minimum mean squared error estimate of X 1 given an observed value of Y = X 1 + X 2. (Hint: Consider E[X 1 + X 2 |X 1 + X 2 ].)

  1. Gaussian Markov chain (from Spring 2007 final). Let X, Y, and Z be jointly Gaussian random variables with zero mean and unit variance, i.e., EX = EY = EZ = 0 and EX^2 = EY 2 = EZ^2 = 1. Let ρX,Y denote the correlation coefficient between X and Y , and let ρY,Z denote the correlation coefficient between Y and Z. Suppose that X and Z are conditionally independent given Y.

(a) Find ρX,Z in terms of ρX,Y and ρY,Z. (b) Find the MMSE estimate of Z given (X, Y ) and the corresponding MSE.

  1. Prediction of an autoregressive process. Let X = [X 1 X 2... Xn]T^ be a random vector with zero mean and covariance matrix

Ī£X =

1 α α^2 Ā· Ā· Ā· αnāˆ’^1 α 1 α α^2 α 1 ..

.... αnāˆ’^1 Ā· Ā· Ā· 1

for |α| < 1. Given the observation X 1 , X 2 ,... , Xnāˆ’ 1 , find the best linear MSE estimate (predictor) of Xn. Compute its MSE.

  1. Noise cancellation. A classical problem in statistical signal processing involves estimat- ing a weak signal (e.g., the heart beat of a fetus) in the presence of a strong interference (the heart beat of its mother) by making two observations; one with the weak signal present and one without (by placing one microphone on the mother’s belly and an- other close to her heart). The observations can then be combined to estimate the weak signal by ā€œcancelling outā€ the interference. The following is a simple version of this application. Let the weak signal X be a random variable with mean μ and variance P , and the observations be Y 1 = X + Z 1 (Z 1 being the strong interference), and Y 2 = Z 1 + Z 2 (Z 2 is a measurement noise), where Z 1 and Z 2 are zero mean with variances N 1 and N 2 , respectively. Assume that X, Z 1 and Z 2 are uncorrelated. Find the best linear MSE estimate of X given Y 1 and Y 2 and its MSE. Interprete the results.