感知机算法实现

最新推荐文章于 2024-07-30 17:23:09 发布

ruo_shui__

最新推荐文章于 2024-07-30 17:23:09 发布

阅读量128

点赞数

文章标签： 1024程序员节 python 机器学习深度学习算法

本文链接：https://blog.csdn.net/ruo_shui__/article/details/127505160

版权

感知机算法实现

公式

$y_{pred}=sign(w^T*x+b)$

$\sum_{t_i\ne sign(w^Tx_i+b)}-t_i(w^Tx_i+b)$

$其中，t_i为真实标签，(w^Tx_i+b)为预测值，损失为分类错误的点的预测值乘以其真实标签的累加取负值)$

$参数更新：w^{nex}=w^{old}+\alpha*\sum_{t_i\ne sign(w^Tx_i+b)}t_ix$

$b^{new}=b^{old}+\sum_{t_i\ne sign(w^Tx_i+b)}\alpha t_i$

数据

x_i	(1,2)	(2,3)	(3,3)	(2,1)	(3,2)
y_i	1	1	1	-1	-1

代码实现

1. 使用循环

import numpy as np
input_feature = 2
lr = 0.01
data = [[1, 2],
        [2, 3],
        [3, 3],
        [2, 1],
        [3, 2]]
labels = [1, 1, 1, -1, -1]
class Model():
    def __init__(self, input_feature):
        self.w = np.ones(input_feature)
        self.b = np.array([0])
        
    def forward_backward(self, data, labels, lr):
        loss = 0
        for x, label in zip(data, labels):
            x = np.array(x)
            a = np.dot(self.w.T, x)+self.b
            output = np.sign(a)
            if output != label:
                self.w = self.w + lr*label*x
                self.b = self.b + lr*label
                loss += -label*(a)
        return loss
    
    def predict(self, x):
        a = np.dot(self.w, x) + b
        result = np.sign(a)
        return result
    

net = Model(input_feature)


for epoch in range(100):
    loss = net.forward_backward(data, labels, lr)
    print(loss)

2. 向量化思想

import numpy as np
input_feature = 2

class Model():
    def __init__(self, input_feature):
        self.w = np.array([1, -1])
        self.b = 0
        
    def forward_backward(self, x, labels, lr):
        a = np.dot(self.w, x)
        output = np.sign(a)
        flag =(output != labels)
        loss = -np.dot(flag*labels, output)
        self.w = self.w + lr*np.dot(x*flag, labels)
        self.b = self.b + lr*(flag*labels)
        return loss
    
    def predict(self, x):
        return np.dot(self.w, x)
    

net = Model(input_feature)
data = [
    [1, 2, 3, 2, 3],
    [2, 3, 3, 1, 2]
]
data = np.array(data)
labels = np.array([1, 1, 1, -1, -1])
lr = 0.5
for epoch in range(100):
    loss = net.forward_backward(data, labels, lr)
    print(loss)