
Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
A concise summary of various machine learning algorithms, including naive bayes, decision trees, k-nearest neighbor, perceptron, support vector machines (svm), neural nets, regression trees, and nearest neighbor regression. It covers key aspects such as input, output, learning methods, complexity control, and notes for each algorithm.
Typology: Exercises
1 / 1
This page cannot be seen from the preview
Don't miss anything!

ML Notes
Naive Bayes boolean feature vector discrete estimating conditional probabilities (counting)
Assumes independent features
LaPlace Correction, XOR
basic Decision Tree boolean feature vector discrete minimizing average entropy at the branches
parametric: leaf size, minimum entropy Continuous-Valued Decision Tree
real feature vector discrete minimizing average entropy at the branches K-Nearest Neighbor real feature vector discrete memorizing all points parametric: K Scaling Perceptron real feature vector discrete maximizing margin (weight space search)
limited to linear separator guarantees separator if it exists SVM real feature vector discrete maximizing margin (quadratic programming)
maximizes margin in error function
Neural Net real feature vector discrete gradient descent (weight space search)
architecture Architecture, Scaling
Neural Net Regression real feature vector real gradient descent (weight space search)
architecture Architecture, Scaling
Regression Trees real feature vector real minimizing variance at the branches
Kernel functions (not SVM kernels) Nearest Neighbor Regression real feature vector real memorizing all points Kernel functions (not SVM kernels)