Machine Learning
Quiz
1. Using the dataset above, calculate the mutual information for each feature (X1,
X2, X3) to determine the root node for a Decision Tree trained on the above data.
Use extra sheets for working and write your final answers below. Attach working
on extra sheet with the quiz.
a. What is MI(Y;X1)?
b. What is MI (Y;X2)?
c. What is MI(Y;X3)?
d. What feature should be split on at the root node?
2. Calculate what the next split should be?
