sklearn 实战第一章

使用sklearn实现手写数字识别

1.sklearn提供了公共数据集

官网公共数据集链接，包含自己创建数据集

2.代码第一步导入包

# Standard scientific Python imports
import matplotlib.pyplot as plt

# Import datasets, classifiers and performance metrics
from sklearn import datasets, svm, metrics

3.加载数字识别数据集

# The digits dataset
digits = datasets.load_digits()

4.观察数据集前四个数据的样式

images_and_labels = list(zip(digits.images, digits.target))
for index, (image, label) in enumerate(images_and_labels[:4]):
    plt.subplot(2, 4, index + 1)
    plt.axis('off')
    plt.imshow(image, cmap=plt.cm.gray_r, interpolation='nearest')
    plt.title('Training: %i' % label)

5.将原始数据改为svc使用的数据样式

print(digits.images.shape)

out:(1797, 8, 8)

需要将三维转化成二维

n_samples = len(digits.images)
data = digits.images.reshape((n_samples, -1))

转换成1797,64的数组

6.创建分类器，并初始化参数

classifier = svm.SVC(gamma=0.001)

维基百科中关于svm的介绍

参数gamma为核参数，因为默认为rbf（radial basis function缩写）其实就是高斯核，而gamma就是1/2σ2

通常我们还指定参数，C惩罚值

7.训练或者拟合训练数据，这里训练集仅取值前一半

classifier.fit(data[:n_samples // 2], digits.target[:n_samples // 2])

注意：target就是我们的样本标签label 即监督学习中图片所对应的数字值

8.预测后一半的数据集

expected = digits.target[n_samples // 2:]
predicted = classifier.predict(data[n_samples // 2:])

9.打印训练模型的准确率，召回率，fscore，数字个数，以及混淆矩阵

print("Classification report for classifier %s:\n%s\n"
      % (classifier, metrics.classification_report(expected, predicted)))
print("Confusion matrix:\n%s" % metrics.confusion_matrix(expected, predicted))

10.可视化预测结果

images_and_predictions = list(zip(digits.images[n_samples // 2:], predicted))
for index, (image, prediction) in enumerate(images_and_predictions[:4]):
    plt.subplot(2, 4, index + 5)
    plt.axis('off')
    plt.imshow(image, cmap=plt.cm.gray_r, interpolation='nearest')
    plt.title('Prediction: %i' % prediction)

 

总体代码

# Standard scientific Python imports
import matplotlib.pyplot as plt

# Import datasets, classifiers and performance metrics
from sklearn import datasets, svm, metrics

# The digits dataset
digits = datasets.load_digits()

# The data that we are interested in is made of 8x8 images of digits, let's
# have a look at the first 4 images, stored in the `images` attribute of the
# dataset.  If we were working from image files, we could load them using
# matplotlib.pyplot.imread.  Note that each image must have the same size. For these
# images, we know which digit they represent: it is given in the 'target' of
# the dataset.
images_and_labels = list(zip(digits.images, digits.target))
for index, (image, label) in enumerate(images_and_labels[:4]):
    plt.subplot(2, 4, index + 1)
    plt.axis('off')
    plt.imshow(image, cmap=plt.cm.gray_r)
    plt.title('Training: %i' % label)

# To apply a classifier on this data, we need to flatten the image, to
# turn the data in a (samples, feature) matrix:
n_samples = len(digits.images)
data = digits.images.reshape((n_samples, -1))
print(digits.images.shape)
# Create a classifier: a support vector classifier
classifier = svm.SVC(gamma=0.001)
# We learn the digits on the first half of the digits
classifier.fit(data[:n_samples // 2], digits.target[:n_samples // 2])
# Now predict the value of the digit on the second half:
expected = digits.target[n_samples // 2:]
predicted = classifier.predict(data[n_samples // 2:])

print("Classification report for classifier %s:\n%s\n"
      % (classifier, metrics.classification_report(expected, predicted)))
print("Confusion matrix:\n%s" % metrics.confusion_matrix(expected, predicted))
images_and_predictions = list(zip(digits.images[n_samples // 2:], predicted))
for index, (image, prediction) in enumerate(images_and_predictions[:4]):
    plt.subplot(2, 4, index + 5)
    plt.axis('off')
    plt.imshow(image, cmap=plt.cm.gray_r, interpolation='nearest')
    plt.title('Prediction: %i' % prediction)
plt.show()