Machine Learning Notebook - Week 1 - Andrew Ng

Intro to ML

• Def of ML by Tom Mitchell:

A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E.

Supervised Learning

Give the algorithm a dataset which contains the right answers(labels), then:

• Regression: teach the algorithm to predict a continuous value output.

Predict the housing price in function of house size

• Classification : teach the algorithm to predict a category value output

Predict a linear function to classify the tumor

Supervised Learning

• Clustering: Give the algorithm a dataset without knowing the labels, then teach the algorithm to cluster them and then given a new data, to predict which cluster it probably belongs to.

Clustering

eg: Google news clusters new stories about the same topics together.

• Cocktail Party Algorithm
  Separate mixed audio source recording into individual voice.

Programming with Octave in Matlab :
[W,s,v]=svd((repmat(sum(x.*x,1),size(x,1),1).*x)*x');

Remark: With unsupervised learning there is no feedback based on the prediction results.