机器学习之Regularized Linear Regression and Bias v.s. Variance

学习中的各种纠结，心得，小知识在代码里面喽

linearRegCostFunction.m

function [J, grad] = linearRegCostFunction(X, y, theta, lambda)
%LINEARREGCOSTFUNCTION Compute cost and gradient for regularized linear 
%regression with multiple variables
%   [J, grad] = LINEARREGCOSTFUNCTION(X, y, theta, lambda) computes the 
%   cost of using theta as the parameter for linear regression to fit the 
%   data points in X and y. Returns the cost in J and the gradient in grad

% Initialize some useful values
m = length(y); % number of training examples

% You need to return the following variables correctly 
J = 0;
grad = zeros(size(theta));

% ====================== YOUR CODE HERE ======================
% Instructions: Compute the cost and gradient of regularized linear 
%               regression for a particular choice of theta.
%
%               You should set J to the cost and grad to the gradient.
%


theta_meddile=theta(2:end);
%搞了半天是截取的问题啊，[0;theta(2:end)]
%theta截取的时候要不要有前面的冒号？？？
J=1 / (2 * m) *sum((X*theta-y).^2)+lambda / (2 * m) *sum(theta_meddile.^2);
%?????为什么theta平方的时候第一项要变成0？？？？？？因为不需要regularize第一项
%正确与否和m的位置无关


%grad = X' * (X*theta - y) / m + [0;theta(2:end)] * lambda / m;
grad=(1/m)*(X'*(X*theta-y))+lambda*(1/m)*[0;theta(2:end)];
%gg=lambda*(1/m)*theta;
%gra