【机器学习】线性分类LogisticRegression

最新推荐文章于 2021-12-02 16:56:05 发布

吊带熊

最新推荐文章于 2021-12-02 16:56:05 发布

阅读量327

点赞数 1

分类专栏：机器学习-算法实现

本文链接：https://blog.csdn.net/explore_me/article/details/54894754

版权

机器学习-算法实现专栏收录该内容

2 篇文章 0 订阅

订阅专栏

一、预测函数HypothesisFunction
function g = sigmoid(z)
%SIGMOID Compute sigmoid functoon
%J = SIGMOID(z) computes the sigmoid of z.

g = 1.0 ./ (1.0 + exp(-z));
end

function H = computeHypothesis(X, theta)

H = sigmoid(X*theta);

end
二、损失函数CostFunction

 
 
  
  function J = computeCost(theta, X, y)
%COMPUTECOST Compute cost for logistic regression
%J = COMPUTECOST(theta, X, y) computes the cost of using theta as the parameter for logistic regression.

% Initialize some useful values
m = length(y);   % number of training examples

h = sigmoid(X * theta);
J = - (y' * log(h) + (1 - y)' * log(1 - h)) / m;

end
  
  
三、最优化参数训练
1.梯度下降GradientDescend

  
  
   
   function [theta, J_history] = gradientDescent(X, y, theta, alpha, num_iters)
%GRADIENTDESCENT Performs gradient descent to learn theta
%theta = GRADIENTDESCENT(x, y, theta, alpha, num_iters) updates theta by taking num_iters gradient steps with learning rate alpha

% Initialize some useful values
m = length(y);                      % number of training examples

h = sigmoid(X * theta);
J_history = zeros(num_iters, 1);

for iter = 1:num_iters

    theta = theta - alpha * X' * (h - y) / m;

    % Save the cost J in every iteration    
    J_history(iter) = computeCost(X, y, theta);

end

end

   
   
四、预测结果Predict