

Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
Material Type: Assignment; Professor: Hajek; Class: Random Processes; Subject: Electrical and Computer Engr; University: University of Illinois - Urbana-Champaign; Term: Spring 2004;
Typology: Assignments
1 / 3
This page cannot be seen from the preview
Don't miss anything!


PROBLEM SET 4 Due Wednesday, March 19
Random Processes, including Poisson, Wiener, Markov and Martingale Processes
Assigned Reading: Chapter 4 of the notes.
Reminder: Exam I will be on Monday, March 10, 7:00 p.m. - 8:15 p.m. in Room 269 EL.
Problems to be handed in:
(b) R = (Rt : t ≥ 0) defined by Rt = D 1 + D 2 + · · · + DNt , where N is a Poisson process with rate λ > 0 and Di : i ≥ 1 is an iid sequence of random variables, each having mean 0 and variance σ^2.
1 2 3
0.6 0.
(b) Find the equilibrium probability distribution π. (c) Let τ = min{k ≥ 0 : Xk = 3} and let ai = E[τ |X 0 = i] for 1 ≤ i ≤ 3. Clearly a 3 = 0. Derive equations for a 1 and a 2 by considering the possible values of X 1 , in a way similar to the analysis of the gambler’s ruin problem given in the notes. Solve the equations to find a 1 and a 2.
1 2 3 10
1
5
1
(b) Find the equilibrium probability distribution π. (c) Let τ = min{t ≥ 0 : Xt = 3} and let ai = E[τ |X 0 = i] for 1 ≤ i ≤ 3. Clearly a 3 = 0. Derive equations for a 1 and a 2 by considering the possible values of Xt(h) for small values of h > 0 and taking the limit as h → 0. Solve the equations to find a 1 and a 2.