

Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
Solutions to problem set 5 of the probability with engineering applications course offered by the department of electrical and computer engineering at the university of illinois, urbana-champaign. The solutions cover various concepts such as linearity of expectation, jensen's inequality, variance, conditional probability, and likelihood and map rules. Students can use this document to check their understanding of these topics and prepare for exams.
Typology: Assignments
1 / 3
This page cannot be seen from the preview
Don't miss anything!


Department of Electrical and Computer Engineering
ECE 313: Probability with Engineering Applications-Fall 2003
Problem Set 5 Solution
Problems to be turned in:
That is, E[f (X)] = f (E[X]), which is a version of Jensen’s inequality. (b) When f (x) = x^2 , x ∈ R, we can appeal to the variance formula,
E[X^2 ]^ −^ (E[X])^2 =^ V ar(X)^ ≥^0. That is, E[f (X)] ≥ f (E[X]). (c) Figure 1 shows the plot of f (x) = x−^1 and fa(x) with a = 1. Since f (x) ≥ fa(x) for all x > 0, we conclude that
E
= E[f (X)] ≥ E[fa(X)] = E[a−^1 − a−^2 (X − a)] = a−^1 − a−^2 (μ − a) ,
where E[X] = μ. The best bound is obtained on setting a = μ, giving
E
≥ a−^1 − a−^2 (a − a) = μ−^1 =
P (S|E) =
P (A | B) = P (B)−^1 P (A ∩ B), P (B | A) = P (A)−^1 P (A ∩ B).
Hence, the first equality follows from the assumption that P (A) = P (B). For the second identity, use the formula based on Axiom III as follows:
P (Ω) = P (A ∪ B) = P (A) + P (B) − P (A ∩ B).
Thus, 1 = 2P (A) − P (A ∩ B), and we obtain, P (A | B) = P (B)−^1 P (A ∩ B) = P (B)−^1 [−1 + 2P (A)].
Using P (A) = P (B) once again, this identity establishes the result.
−4 0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 5
−
0
2
4
6
8
10 f(x)f a(x), a=
Figure 1: The plot of f (x) and fa(x) with a = 1.
P (A) = p 0 = p + 1 − p 6 P (B) = p P (A ∩ B) = P (B) = p
P (B|A) =
p p + 1 − 6 p
6 p 5 p − 1
(b) The probabilities of a correct answer are independent, and identically distributed, with proba- bility p 0. Consequently, the number of incorrect answers W is binomial (N, q) with q = 1 − p 0. (Here, p 0 is the probability that any given answer is correct.) (c) Since P (K = k) =
k
pk(1 − p)N^ −k^ and P (W = w) =
w
qw(1 − q)N^ −w,
P (W = w|K = k) =
N − k w
)w( 1 6
)N −k−w
P (K = k|W = w) =
P (K = k) P (W = w) · P (W = w|K = k)
k
pk(1 − p)N^ −k (N w
qw(1 − q)N^ −w^
N − k w
)w( 1 6
)N −k−w ,
where q = 1 − p 0 = 1 − (p + 1 − 6 p) = 56 (1 − p).
XY 00 01 02 10 11 12 20 21 22 H 0 0.56 0.16 0.08 0.07 0.02 0.01 0.07 0.02 0. H 1 0.01 0.01 0.08 0.03 0.03 0.24 0.06 0.06 0.