Problem Set 4 - Random Processes - Spring 2003 | ECE 534, Assignments of Electrical and Electronics Engineering

Material Type: Assignment; Professor: Hajek; Class: Random Processes; Subject: Electrical and Computer Engr; University: University of Illinois - Urbana-Champaign; Term: Spring 2004;

Typology: Assignments

Pre 2010

Uploaded on 03/16/2009

koofers-user-q3y
koofers-user-q3y 🇺🇸

3

(2)

8 documents

1 / 3

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
ECE 434 RANDOM PROCESSES SPRING 2003
PROBLEM SET 4 Due Wednesday, March 19
Random Processes, including Poisson, Wiener, Markov and Martingale Processes
Assigned Reading: Chapter 4 of the notes.
Reminder: Exam I will be on Monday, March 10, 7:00 p.m. - 8:15 p.m. in Room 269 EL.
Problems to be handed in:
1. Let Xt=Acos(W t +Y) where A, W and Yare independent random variables, Ahas mean 2
and variance 4, Yis uniform on [π,π] and Wis uniform on [0,5]. Find the mean function µX(t)
and autocorrelation function RX(s, t).Is Xwide sense stationary?
2. Let Yand Zbe independent random processes with
RY(s, t) = 2 exp(−|st|) cos(2πf(st)) and RZ(s, t) = 9+exp(3|st|4).Find the autocorrelation
function RX(s, t) where Xt=YtZt.
3. Suppose that X1and X2are random variables such that EX1=EX2=E X1X2= 0 and
V ar(X1) = V ar(X2) = σ2. Define Yt=X1sin(t) + X2cos(t). (a) Is the random process Y
necessarily wide-sense stationary? (b) Give an example of random variables X1and X2satisfying
the given conditions such that Yis not (strict sense) stationary. (c) Give an example of random
variables X1and X2satisfying the given conditions such that Yis stationary.
4. Define a random process Xby Xt=A+Bt+t2, where Aand Bare independent, N(0,1) random
variables. (a) Find ˆ
E[X5|X1], the linear minimum mean square error (LMMSE) estimator of X5
given X1, and compute the mean square error. (b) Find the MMSE (possibly nonlinear) estimator
of X5given X1, and compute the mean square error. (c) Find ˆ
E[X5|X0, X1] and compute the mean
square error. (Hint: Can do by inspection.)
5. Define the random process Xby Xt= 2A+Bt where Aand Bare independent random variables
with P[A= 1] = P[A=1] = P[B= 1] = P[B=1] = 0.5. (a) Sketch the possible sample
functions. (b) Find P[Xt0] for all t. (c) Find P[Xt0 for all t].
6. Identification of special properties of two discrete time processes
Determine which of the properties:
(i) Markov property
(ii) martingale property
(iii) independent increment property
are possessed by the following two random processes. Justify your answers.
(a) X= (Xk:k0) defined recursively by X0= 1 and Xk+1 = (1 + Xk)Ukfor k0, where
U0, U1,... are independent random variables, each uniformly distributed on the interval [0,1].
(b) Y= (Yk:k0) defined by Y0=V0,Y1=V0+V1, and Yk=Vk2+Vk1+Vkfor k2, where
Vk:kZare independent Gaussian random variables with mean zero and variance one.
7. Identification of special properties of two continuous time processes
Answer as in the previous problem, for the following two random processes:
(a) Z= (Zt:t0), defined by Zt= exp(Wtσ2t
2), where Wis a Brownian motion with parameter
σ2. (Hint: Observe that E[Zt] = 1 for all t.)
1
pf3

Partial preview of the text

Download Problem Set 4 - Random Processes - Spring 2003 | ECE 534 and more Assignments Electrical and Electronics Engineering in PDF only on Docsity!

ECE 434 RANDOM PROCESSES SPRING 2003

PROBLEM SET 4 Due Wednesday, March 19

Random Processes, including Poisson, Wiener, Markov and Martingale Processes

Assigned Reading: Chapter 4 of the notes.

Reminder: Exam I will be on Monday, March 10, 7:00 p.m. - 8:15 p.m. in Room 269 EL.

Problems to be handed in:

  1. Let Xt = A cos(W t + Y ) where A, W and Y are independent random variables, A has mean 2 and variance 4, Y is uniform on [−π, π] and W is uniform on [0,5]. Find the mean function μX (t) and autocorrelation function RX (s, t). Is X wide sense stationary?
  2. Let Y and Z be independent random processes with RY (s, t) = 2 exp(−|s−t|) cos(2πf (s−t)) and RZ (s, t) = 9+exp(− 3 |s−t|^4 ). Find the autocorrelation function RX (s, t) where Xt = YtZt.
  3. Suppose that X 1 and X 2 are random variables such that EX 1 = EX 2 = EX 1 X 2 = 0 and V ar(X 1 ) = V ar(X 2 ) = σ^2. Define Yt = X 1 sin(t) + X 2 cos(t). (a) Is the random process Y necessarily wide-sense stationary? (b) Give an example of random variables X 1 and X 2 satisfying the given conditions such that Y is not (strict sense) stationary. (c) Give an example of random variables X 1 and X 2 satisfying the given conditions such that Y is stationary.
  4. Define a random process X by Xt = A+Bt+t^2 , where A and B are independent, N (0, 1) random variables. (a) Find Eˆ[X 5 |X 1 ], the linear minimum mean square error (LMMSE) estimator of X 5 given X 1 , and compute the mean square error. (b) Find the MMSE (possibly nonlinear) estimator of X 5 given X 1 , and compute the mean square error. (c) Find Eˆ[X 5 |X 0 , X 1 ] and compute the mean square error. (Hint: Can do by inspection.)
  5. Define the random process X by Xt = 2A+Bt where A and B are independent random variables with P [A = 1] = P [A = −1] = P [B = 1] = P [B = −1] = 0.5. (a) Sketch the possible sample functions. (b) Find P [Xt ≥ 0] for all t. (c) Find P [Xt ≥ 0 for all t].
  6. Identification of special properties of two discrete time processes Determine which of the properties: (i) Markov property (ii) martingale property (iii) independent increment property are possessed by the following two random processes. Justify your answers. (a) X = (Xk : k ≥ 0) defined recursively by X 0 = 1 and Xk+1 = (1 + Xk)Uk for k ≥ 0, where U 0 , U 1 ,... are independent random variables, each uniformly distributed on the interval [0, 1]. (b) Y = (Yk : k ≥ 0) defined by Y 0 = V 0 , Y 1 = V 0 + V 1 , and Yk = Vk− 2 + Vk− 1 + Vk for k ≥ 2, where Vk : k ∈ Z are independent Gaussian random variables with mean zero and variance one.
  7. Identification of special properties of two continuous time processes Answer as in the previous problem, for the following two random processes: (a) Z = (Zt : t ≥ 0), defined by Zt = exp(Wt − σ (^2) t 2 ), where^ W^ is a Brownian motion with parameter σ^2. (Hint: Observe that E[Zt] = 1 for all t.)

(b) R = (Rt : t ≥ 0) defined by Rt = D 1 + D 2 + · · · + DNt , where N is a Poisson process with rate λ > 0 and Di : i ≥ 1 is an iid sequence of random variables, each having mean 0 and variance σ^2.

  1. Mean hitting time for a discrete time, discrete space Markov process Let (Xk : k ≥ 0) be a time-homogeneous Markov process with the one-step transition probability diagram shown. (a) Write down the one step transition probability matrix P.

1 2 3

0.6 0.

(b) Find the equilibrium probability distribution π. (c) Let τ = min{k ≥ 0 : Xk = 3} and let ai = E[τ |X 0 = i] for 1 ≤ i ≤ 3. Clearly a 3 = 0. Derive equations for a 1 and a 2 by considering the possible values of X 1 , in a way similar to the analysis of the gambler’s ruin problem given in the notes. Solve the equations to find a 1 and a 2.

  1. Mean hitting time for a continuous time, discrete space Markov process Let (Xt : t ≥ 0) be a time-homogeneous Markov process with the transition rate diagram shown. (a) Write down the rate matrix Q.

1 2 3 10

1

5

1

(b) Find the equilibrium probability distribution π. (c) Let τ = min{t ≥ 0 : Xt = 3} and let ai = E[τ |X 0 = i] for 1 ≤ i ≤ 3. Clearly a 3 = 0. Derive equations for a 1 and a 2 by considering the possible values of Xt(h) for small values of h > 0 and taking the limit as h → 0. Solve the equations to find a 1 and a 2.

  1. Distribution of holding time for discrete state Markov processes (a) Let (Xk : k ≥ 0) be a time-homogeneous Markov process with one-step transition probability matrix P. Fix a given state i, suppose that P [X 0 = i] = 1, and let τ = min{k ≥ 0 : Xk 6 = i}. Find the probability distribution of τ. What well known type of distribution does τ have, and why should that be expected? (Hint: The distribution is completely determined by pii. For example, if pii = 0 then P [τ = 1] = 1.) (b) Let (Xt : t ≥ 0) be a time-homogeneous Markov process with transition rate matrix Q. Fix a given state i, suppose that P [X 0 = i] = 1, and let τ = min{t ≥ 0 : Xt 6 = i}. This problem will lead to your finding the probability distribution of τ. For h > 0, let hR = {nh : n ≥ 0 }. Note that {Xt : t ∈ hR} is a discrete-time Markov process with one step transition probability matrix H(h) = (pkj (h)), although the time between steps is h, rather than the usual one time unit. Let τ h^ = min{t ∈ hR : Xt 6 = i}. (i) Describe the probability distribution of τ h. (Hint: the parameter will be the transition proba- bility for an interval of length h: pii(h).) (ii) Show that limh→ 0 τ h^ = τ a.s. Since convergence a.s. implies convergence in d., it follows that limh→ 0 τ h^ = τ d., so the distribu- tion of τ , which we seek to find, is the limit of the distributions of τ h. (iii) The distribution of τ h^ converges to what distribution as h → 0? This is the distribution of τ. What well known type of distribution does τ have, and why should that be expected? (Hint: The limit can be identified by taking either the limit of the cumulative distribution functions, or the limit of the characteristic functions.)