Probability Solutions for ECE 313 Problem Set 6, University of Illinois, Fall 2008 - Prof., Assignments of Statistics

Solutions to problem set 6 of the ece 313 course offered at the university of illinois during the fall 2008 semester. It covers various probability concepts, including conditional probability and bayes' theorem.

Typology: Assignments

Pre 2010

Uploaded on 03/16/2009

koofers-user-any
koofers-user-any 🇺🇸

10 documents

1 / 2

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
University of Illinois Fall 2008
ECE 313: Solutions to Problem Set 6
1. Let X= bit stored, Y= bit read
(a) P(Y= 1) = P(Y= 1|X= 1)P(X= 1) + P(Y= 1|X= 0)P(X= 0)
= (0.85)(0.5) + (0.1)(0.5) = 0.475.
(b) P(X= 1|Y= 1) = P(Y=1,X=1)
P(Y=1) =P(X=1)P(Y=1|X=1)
P(Y=1) =(0.5)(0.85)
0.475 = 0.8947.
2. (a) P(T+) = P(T+|H+)P(H+) + P(T+|H)P(H).
Test A: P(T+) = (0.999)(0.02) + (0.01)(0.98) = 0.02978.
Test B: P(T+) = (0.99)(0.02) + (0.001)(0.98) = 0.02078.
(b) P(H+|T+) = P(H+,T +)
P(T+) =P(H+)P(T+|H+)
P(T+) .
Test A: P(H+|T+) = (0.02)(0.999)
(0.02978) = 0.67092.
Test B: P(H+|T+) = (0.02)(0.99)
(0.02078) = 0.952839.
(c) P(H+|T) = P(H+)P(T−|H+)
P(T)=P(H+)[1P(T+|H+)]
[1P(T+)] .
Test A: P(H+|T) = (0.98)(10.999)
(10.2978) = 0.00101.
Test B: P(H+|T) = (0.98)(10.99)
(10.2078) = 0.010008.
3. (a) Note that each row of the matrix (call it A) is just the conditional pmf of Yconditioned on
the value of X. Let ~
PX= [0.5,0.25,0.25] be the pmf vector for X. Then, ~
PY=~
PXA. More
specifically, P{Y =j}=P3
i=1 P{Y =j|X =i}P{X =i}
=
0.8×0.5+0.05 ×0.25 + 0.15 ×0.25 = 0.45 for j= 1
0.1×0.5+0.9×0.25 + 0.05 ×0.25 = 0.2875 for j= 2
0.1×0.5+0.05 ×0.25 + 0.8×0.25 = 0.2625 for j= 3
Sanity check: the three probabilities sum to 1.
(b) P{X =i|Y = 3}=P{Y = 3|X =i}P{X =i}
P{Y = 3}=
0.1×0.5
0.2625 =4
21 for i= 1,
0.05×0.25
0.2625 =1
21 for i= 2,
0.8×0.25
0.2625 =16
21 for i= 3.
This is the conditional pmf of Xgiven that Ywas observed to have value 3. Note that the sum
of the three probabilities is 1, as it should be for a valid pmf.
4. (a) P(F1) = P(F1|E1)P(E1) + P(F1|E2)P(E2) + P(F1|E3)P(E3) + P(F1|E4)P(E4)
= (0.9)(0.4) + (0)(0.3) + (0)(0.2) + (0)(0.1) = 0.36
(b) If the MS was found on the first page, it implies that the MS is located in cell 1 P(E1|F1) = 1.
(c) No matter which cell the MS is located in, the first time the MS is paged in the cell in which
it is located, it will be missed with probability 0.1. Given that the MS is missed in the first
round, it will be missed again in the second round with conditional probability 0.1. So P(G8) =
(0.1)(0.1) = 0.01.
(d) Now P(F2|G1) = P(F2G1
P(G1). By the law of total probability with the partition consisting of events
E1, E2, E3, E4,
P(G1) = P(G1|E1)P(E1) + P(G1|E2)P(E2) + P(G1|E3)P(E3) + P(G1|E4)P(E4)
= (0.1)(0.4) + (1)(0.3) + (1)(0.2) + (1)(0.1) = 0.64
and
P(F2G1) = P(F2G1|E1)P(E1) + P(F2G1|E2)P(E2) + P(F2G1|E3)P(E3)
+P(F2G1|E4)P(E4)
= (0)(0.4) + (0.9)(0.3) + (0)(0.2) + (0)(0.1) = 0.27
pf2

Partial preview of the text

Download Probability Solutions for ECE 313 Problem Set 6, University of Illinois, Fall 2008 - Prof. and more Assignments Statistics in PDF only on Docsity!

University of Illinois Fall 2008

ECE 313: Solutions to Problem Set 6

  1. Let X = bit stored, Y = bit read (a) P (Y = 1) = P (Y = 1|X = 1)P (X = 1) + P (Y = 1|X = 0)P (X = 0) = (0.85)(0.5) + (0.1)(0.5) = 0.475. (b) P (X = 1|Y = 1) = P^ (Y P^ =1(Y ,X=1)=1) = P^ (X=1) PP (Y^ ( Y=1)^ =1 |X=1)= (0.5)(0 0. 475 .85) = 0.8947.
  2. (a) P (T +) = P (T + |H+)P (H+) + P (T + |H−)P (H−). Test A: P (T +) = (0.999)(0.02) + (0.01)(0.98) = 0.02978. Test B: P (T +) = (0.99)(0.02) + (0.001)(0.98) = 0.02078. (b) P (H + |T +) = P^ ( PH (+T ,T+)^ +) = P^ (H+) PP (T^ (T +)^ + |H+). Test A: P (H + |T +) = (0(0.02)(0.02978).999) = 0.67092. Test B: P (H + |T +) = (0(0.02)(0.02078).99) = 0.952839. (c) P (H + |T −) = P^ (H+) PP (T^ ( T−^ −|) H+)= P^ (H+)[1[1−−PP (T^ ( T+)]^ +| H+)]. Test A: P (H + |T −) = (0.(198)(1− 0 .−2978)^0 .999) = 0.00101. Test B: P (H + |T −) = (0(1.98)(1− 0 .2078)−^0 .99) = 0.010008.
  3. (a) Note that each row of the matrix (call it A) is just the conditional pmf of Y conditioned on the value of X. Let P~X = [0. 5 , 0. 25 , 0 .25] be the pmf vector for X. Then, P~Y = P~X A. More specifically, P {Y = j} =

i=1 P^ {Y^ =^ j|X^ =^ i}P^ {X^ =^ i}

  1. 8 × 0 .5 + 0. 05 × 0 .25 + 0. 15 × 0. 25 = 0. 45 for j = 1
  2. 1 × 0 .5 + 0. 9 × 0 .25 + 0. 05 × 0. 25 = 0. 2875 for j = 2
  3. 1 × 0 .5 + 0. 05 × 0 .25 + 0. 8 × 0. 25 = 0. 2625 for j = 3 Sanity check: the three probabilities sum to 1.

(b) P {X = i|Y = 3} = P^ {Y^ = 3 P|X {Y^ = = 3^ i}P}^ {X =^ i}=

  1. 1 × 0. 5
  2. 2625 =^

4

  1. 05 × 0. 25 21 for^ i^ = 1,
  2. 2625 =^

1

  1. 8 × 0. 25 21 for^ i^ = 2,
  2. 2625 =^

16 21 for^ i^ = 3. This is the conditional pmf of X given that Y was observed to have value 3. Note that the sum of the three probabilities is 1, as it should be for a valid pmf.

  1. (a) P (F 1 ) = P (F 1 |E 1 )P (E 1 ) + P (F 1 |E 2 )P (E 2 ) + P (F 1 |E 3 )P (E 3 ) + P (F 1 |E 4 )P (E 4 ) = (0.9)(0.4) + (0)(0.3) + (0)(0.2) + (0)(0.1) = 0. 36 (b) If the MS was found on the first page, it implies that the MS is located in cell 1 ⇒ P (E 1 |F 1 ) = 1. (c) No matter which cell the MS is located in, the first time the MS is paged in the cell in which it is located, it will be missed with probability 0.1. Given that the MS is missed in the first round, it will be missed again in the second round with conditional probability 0.1. So P (G 8 ) = (0.1)(0.1) = 0.01. (d) Now P (F 2 |G 1 ) = P P^ ( (FG^2 G 1 )^1. By the law of total probability with the partition consisting of events E 1 , E 2 , E 3 , E 4 , P (G 1 ) = P (G 1 |E 1 )P (E 1 ) + P (G 1 |E 2 )P (E 2 ) + P (G 1 |E 3 )P (E 3 ) + P (G 1 |E 4 )P (E 4 ) = (0.1)(0.4) + (1)(0.3) + (1)(0.2) + (1)(0.1) = 0. 64 and P (F 2 G 1 ) = P (F 2 G 1 |E 1 )P (E 1 ) + P (F 2 G 1 |E 2 )P (E 2 ) + P (F 2 G 1 |E 3 )P (E 3 ) +P (F 2 G 1 |E 4 )P (E 4 ) = (0)(0.4) + (0.9)(0.3) + (0)(0.2) + (0)(0.1) = 0. 27

Thus, P (F 2 |G 1 ) =^0.^27

  1. 64

(e) We are seeking P (F 4 |G 3 ) = P^ (F^4 G^3 ) P (G 3 )

,where

P (G 3 ) = P (G 3 |E 1 )P (E 1 ) + P (G 3 |E 2 )P (E 2 ) + P (G 3 |E 3 )P (E 3 ) +P (G 3 |E 4 )P (E 4 ) = (0.1)(0.4) + (0.1)(0.3) + (0.1)(0.2) + (1)(0.1) = 0. 19 and P (F 4 G 3 ) = P (F 4 G 3 |E 1 )P (E 1 ) + P (F 4 G 3 |E 2 )P (E 2 ) + P (F 4 G 3 |E 3 )P (E 3 ) +P (F 4 G 3 |E 4 )P (E 4 ) = (0)(0.4) + (0)(0.3) + (0)(0.2) + (0.9)(0.1) = 0. 09

Thus, P (F 4 |G 3 ) =^0.^09

  1. 19

(f) We are seeking P (F 8 |G 7 ) = P^ (F^8 G^7 ) P (G 7 )

,where

P (G 7 ) = P (G 7 |E 1 )P (E 1 ) + P (G 7 |E 2 )P (E 2 ) + P (G 7 |E 3 )P (E 3 ) +P (G 7 |E 4 )P (E 4 ) = (0.01)(0.4) + (0.01)(0.3) + (0.01)(0.2) + (0.1)(0.1) = 0. 019 and P (F 8 G 7 ) = P (F 8 G 7 |E 1 )P (E 1 ) + P (F 8 G 7 |E 2 )P (E 2 ) + P (F 8 G 7 |E 3 )P (E 3 ) +P (F 8 G 7 |E 4 )P (E 4 ) = (0)(0.4) + (0)(0.3) + (0)(0.2) + (0.09)(0.1) = 0. 009

Thus, P (F 8 |G 7 ) =^0.^009

  1. 019

Note: An explanation for why the answer to (d) is the same as the answer to (c) is that if the MS is not found after the first round of four pages, the conditional distribution of which cell the MS is located in is the same as the original distribution.

  1. P (guilty) = 0.8. P (Bolies|guilty) = 0.2. P (Claralies|innocent) = 0.3.

(a) P (Bolies) = P (Bolies|guilty)P (guilty) + P (Bolies|innocent)P (innocent) = (0.2)(0.8) + (0)(0.2) = 0.16. P (Claralies) = P (Claralies|guilty)P (guilty) + P (Claralies|innocent)P (innocent) = (0)(0.8) + (0.3)(0.2) = 0. 06 So Clara is more likely to testify truthfully. (b) Conflicting testimony results when either Bo or Clara lies, but the other tells the truth. Since Bo lies only when Adam is guilty and Clara lies only when Adam is innocent, these events are mutually exclusive, and we can simply add the probabilities: P (conf lict) = P (Bolies) + P (Claralies) = 0. 22 (c) P (innocent|conf lict) = P^ (innocent,conf lict P (conf lict) )= P^ (innocent P)P (conf lict^ (conf lict)|innocent) = P^ (innocent P)P (^ conf lict(claralies) |innocent)== (0.2)(0 0. 22. 3)= 0. 2727

  1. P (A) = P (B) = 12. P (C) = ( 12 )( 12 )^2

1

(a) Yes. P (AC) = P (A)P (C|A) = ( 12 )( 12 )^2 = 18 = P (A)P (C). (b) No. P (BC) = P (B)P (C|B) = ( 12 )( 12 )^2

1

= 14 6 = P (B)P (C) = 18.

(c) No. B and C are not independent. (d) No. B and C are not independent.