ADTP: Statistical Pattern Recognition - Practice Exam | CS 591Q, Exams of Computer Science

Material Type: Exam; Professor: Ross; Class: ADTP:Statistcl Pattrn Recogntn; Subject: Computer Science; University: West Virginia University; Term: Spring 2008;

Typology: Exams

Pre 2010

Uploaded on 07/30/2009

koofers-user-lvy
koofers-user-lvy 🇺🇸

10 documents

1 / 2

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Name: ———————-
Practice Exam
CS 591Q/791V - Pattern Recognition
Total Points: 60
Date: Posted on May 3, 2008
1. [15 points] Briefly describe each of the following terms in the context of pattern recognition with
an example.
(a) Bayes Risk.
(b) Bayesian Learning.
(c) Voronoi Tessellation.
2. [15 points] In many pattern classification problems one has the option either to assign the pattern
to one of cclasses, or to reject it as being unrecognizable. If the cost of rejecting is not too high,
it may be a desirable action.
Let
λ(αi|ωj) =
0if i=j, i, j = 1,2,...c
λrif i=c+ 1
λsotherwise,
where λris the loss incurred for choosing the (c+ 1)th action (i.e, rejection), and λsis the loss
incurred for making any substitution error. Show that the minimum risk decision rule is obtained
as follows:
If both the following conditions are satisfied:
P(ωi|x)P(ωj|x),j,
P(ωi|x)1λr
λs,
then assign pattern xto class ωi,
else reject pattern x.
3. [15 points] MLE methods apply to estimates of prior probabilities as well. Consider a set of
labeled patterns in a “bag”. Each pattern can belong to one of cclasses, ω1, ω2,...ωc, whose
priors, P(ωi), are unknown. Now consider an experiment where patterns are successively (and
independently) drawn from the “bag” and their class noted. Let zik = 1 if the kth pattern drawn
from the bag belongs to class ωiand zik = 0 otherwise.
1
pf2

Partial preview of the text

Download ADTP: Statistical Pattern Recognition - Practice Exam | CS 591Q and more Exams Computer Science in PDF only on Docsity!

Name: ———————-

Practice Exam

CS 591Q/791V - Pattern Recognition

Total Points: 60

Date: Posted on May 3, 2008

  1. [15 points] Briefly describe each of the following terms in the context of pattern recognition with an example.

(a) Bayes Risk. (b) Bayesian Learning. (c) Voronoi Tessellation.

  1. [15 points] In many pattern classification problems one has the option either to assign the pattern to one of c classes, or to reject it as being unrecognizable. If the cost of rejecting is not too high, it may be a desirable action. Let

λ(αi|ωj ) =

0 if i = j, i, j = 1, 2 ,... c λr if i = c + 1 λs otherwise,

where λr is the loss incurred for choosing the (c + 1)th^ action (i.e, rejection), and λs is the loss incurred for making any substitution error. Show that the minimum risk decision rule is obtained as follows: If both the following conditions are satisfied:

  • P (ωi|x) ≥ P (ωj |x), ∀j,
  • P (ωi|x) ≥ 1 − λ λrs ,

then assign pattern x to class ωi, else reject pattern x.

  1. [15 points] MLE methods apply to estimates of prior probabilities as well. Consider a set of labeled patterns in a “bag”. Each pattern can belong to one of c classes, ω 1 , ω 2 ,... ωc, whose priors, P (ωi), are unknown. Now consider an experiment where patterns are successively (and independently) drawn from the “bag” and their class noted. Let zik = 1 if the kth^ pattern drawn from the bag belongs to class ωi and zik = 0 otherwise.

(a) Show that

P (zi 1 , zi 2 ,... zin|P (ωi)) =

∏^ n

k=

P (ωi)zik^ (1 − P (ωi))^1 −zik^.

(b) Show that the MLE for P (ωi) is

P^ ˆ (ωi) =^1 n

∑^ n

k=

zik.

Interpret your results in words.

  1. Consider a training set consisting of 8 two-dimensional points: {(1,1), (1,2), (2,1), (2,2), (3,1), (3,2), (4,1), (4,2)}. Assume that these points are drawn from a Gaussian density function, N(μ, Σ), with unknown mean and covariance matrix.

(a) [2 points] Plot the training set of points. (b) [3 points] Based on the training set, what is the maximum likelihood estimate for the mean? (c) [5 points] Based on the training set, what is the maximum likelihood estimate for the covari- ance matrix? (d) [5 points] What is the Euclidean distance between (1,1) and (4,2)? What is the Mahalanobis distance between (1,1) and (4,2)?