

Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
Solutions to homework problems 3.3, 3.5, and 3.7 in a mathematics 171 course. Topics covered include poisson random variables, independence of random variables, irreducible markov chains, and mean transit times.
Typology: Assignments
1 / 2
This page cannot be seen from the preview
Don't miss anything!


Math 171 Homework #
a. Since X and Y are Poisson, then Xti − Xsi and Yti − Ysi are independent random variables in non-overlapping intervals ti −si. Thus Xti −Xsi +Yti −Ysi are independent. If events in X and Y occur one at a time, then X + Y occurs one at a time. The only other possibility is that an event in X and Y occur at the same time. But this occurs with probability lim∆t→ 0 λ 1 λ 2 (∆t)^2. Events in Z occur with rate (λ 1 + λ 2 ).
b. We get (^) λ 1 λ+^1 λ 2.
c. The probability that someone has called phone 1 is 1 − e−λ^1 t. The prob- ability that someone has called both phones is then (1 − e−λ^1 t)(1 − e−λ^2 t) = {T ≤ t}.
1 2 1 − 1 1 2 4 − 4
Pt = etA
=
0 e−^5 t
Consider two arbitrary states i,j. Because the system is irreducible, we know that there exit z 1 , z 2 ,... , xk ∈ S with α(x, z 1 ), α(z 1 , z 2 ),... , α(zk− 1 , zk), α(zk, y) all strictly positive. We can divide time into (k + 1) subintervals and write
P{Xt = j|X 0 = i} ≥ P{Xt/(k+1) = z 1 |X 0 = i}P{X 2 t/(k+1) = z 2 |Xt/(k+1) = z 1 } · · ·
· · · P{Xkt/(k+1) = zk|X(k−1)t/(k+1) = zk− 1 }P{Xt = j|Xkt/(k+1) = zk} ≥ α(i, z 1 )(t/(k + 1))α(z 1 , z 2 )(t/(k + 1)) · · · α(zk, j)(t/(k + 1)) ≥ 0
a. The equilibrium distributin is the left eigenvector of A corresponding to eigenvalue 0. This is
b. The rate at which the system leaves state 1 is α(1) = 3, so the expected time to leave that state is 1/3.
c. Remove state four from the matrix to get
1 2 3 1 − 3 1 1 2 0 − 3 2 3 1 2 − 4
Then [− A˜]−^1 ¯1 = ¯1, so the mean transit time is 1.