吴恩达编程练习：Programming Exercise 1: Linear Regression

1:with one variable

在只有单一变量的情况下使用线性回归方法来预测下一次房价，根据题目要求要完成一下两个函数：

J = computeCost(X, y, theta)；其中X是输入的训练样本的矩阵，each row 代表的是一个训练样本的不同特征，each column代表的是针对该特征所有样本的该特征值。y是训练样本对应的标签（即结果）列向量。theta是在线性回归中假设函数的方程参数列向量，即y = X*theat。用来计算X，y，theta对应的代价函数。

[theta, J_history] = gradientDescent(X, y, theta, alpha, num_iters)；其中X，y，theta和上面解释的一致，alpha是学习率在上一次笔记中对其经行过解释，合适的学习率有利于学习算法的收敛和迭代速度。num_iters是设置的迭代次数。梯度下降法函数，通过梯度下降法来不断的更新theta来是J按照最快的速度下降，收敛到局部最小值。

function [theta, J_history] = gradientDescent(X, y, theta, alpha, num_iters)
%GRADIENTDESCENT Performs gradient descent to learn theta
%   theta = GRADIENTDESCENT(X, y, theta, alpha, num_iters) updates theta by 
%   taking num_iters gradient steps with learning rate alpha

% Initialize some useful values
m = length(y); % number of training examples
J_history = zeros(num_iters, 1);

for iter = 1:num_iters

    % ====================== YOUR CODE HERE ======================
    % Instructions: Perform a single gradient step on the parameter vector
    %               theta. 
    %
    % Hint: While debugging, it can be useful to print out the values
    %       of the cost function (computeCost) and gradient here.
    %
    A = (X*theta - y)';
    B = (A*X)';

    theta = theta - alpha/m*(B);





    
    % ============================================================

    % Save the cost J in every iteration    
    J_history(iter) = computeCost(X, y, theta);

end

end

function J = computeCost(X, y, theta)
%COMPUTECOST Compute cost for linear regression
%   J = COMPUTECOST(X, y, theta) computes the cost of using theta as the
%   parameter for linear regression to fit the data points in X and y

% Initialize some useful values
m = length(y); % number of training examples

% You need to return the following variables correctly 
J = 0;

% ====================== YOUR CODE HERE ======================
% Instructions: Compute the cost of a particular choice of theta
%               You should set J to the cost.

A = (X*theta-y).^2(:);
J = sum(A)/(2*m);



% =========================================================================

end

上面是两个函数对应的程序。