Feature selection Regularisation: general idea Structural risk minimization SVMs and structural risk minimisation L2 and L1 penalization The pictures of L1 and L2 penalization Bias and variance as a function of the weight of penalty