首先导入包:
import matplotlib.pyplot as plt
import numpy as np
from matplotlib.colors import ListedColormap
from sklearn.datasets import load_iris
获取数据:
iris = load_iris()
X = iris.data[:, (1, 3)]
y = iris.target
设置画图的颜色深浅:
cmap_light = ListedColormap(['#FFAAAA', '#AAFFAA', '#AAAAFF'])
cmap_bold = ListedColormap(['#FF0000', '#00FF00', '#0000FF']
决策边界,用不同的颜色表示:
x_min, x_max = X[:, 0].min() - 0.1, X[:, 0].max() + 0.1
y_min, y_max = X[:, 1].min() - 0.1, X[:, 1].max() + 0.1
xx, yy = np.meshgrid(np.arange(x_min, x_max, 0.02),
np.arange(y_min, y_max, 0.02))
KNN原理:
def knn_code(loc, k=5, order=2 ):
diff_loc = X - loc
dis_loc = np.linalg.norm(diff_loc, ord=order, axis=1)
knn = y[dis_loc.argsort()[:k]]
counts = np.bincount(knn)
return np.argmax(counts
将数据合并:
line_loc = np.array(list(zip(xx.ravel(), yy.ravel())))
进行画图:
plt.figure(figsize=(15, 12))
pos = 1
for k in [2, 6]:
for order in [1, 2]:
Z = np.array([knn_code(ii, k, order) for ii in line_loc]).reshape(xx.shape)
ax = plt.subplot(220 + pos)
ax.pcolormesh(xx, yy, Z, cmap=cmap_light, shading='auto')
ax.scatter(X[:, 0], X[:, 1], c=y, cmap=cmap_bold)
ax.set_title(f'k: {k}, distance order: {order}')
pos += 1
plt.suptitle('I am a tuner!')
plt.show()
可视化展示: