2019-10-11 opencv机器学习2-SVM2-使用SVM识别手写数据OCR

官网https://docs.opencv.org/3.4.1/dd/d3b/tutorial_py_svm_opencv.html

手写数字的OCR

在kNN中，我们使用像素灰度值作为特征向量。这次我们使用方向梯度直方图（Histogram of Oriented Gradients ，简称HOG)作为特征向量。

在计算HOG之前，我们需要使用图像的二阶矩来进行抗扭斜处理。下面是自定义的deskew()函数，用于图像抗扭斜。

def deskew(img):
    m = cv2.moments(img)
    if abs(m['mu02']) < 1e-2:
        return img.copy()
    skew = m['mu11']/m['mu02']
    M = np.float32([[1, skew, -0.5*SZ*skew], [0, 1, 0]])
    img = cv2.warpAffine(img,M,(SZ, SZ),flags=affine_flags)
    return img

下图显示了对含有数字0的图像进行抗扭斜处理后的效果。左侧是原始图像，右侧是处理后的结果。

现在我们就可以计算HOG描述符了。为此，我们要计算X和Y方向的Sobel 导数。然后计算每个像素的梯度的方向和大小。再把梯度转换为16位整数。接着把图像分为4个子方块。对于每个子方块计算它的直方图(16bins)，权重为梯度的大小。这样每一个子方块都会得到一个含有16个值的向量。4个向量（对应4个子方块）汇总给我们组成了有64个值的特征向量。这个特征向量会被用于训练数据。

def hog(img):
    gx = cv2.Sobel(img, cv.CV_32F, 1, 0)
    gy = cv2.Sobel(img, cv.CV_32F, 0, 1)
    mag, ang = cv2.cartToPolar(gx, gy)
    bins = np.int32(bin_n*ang/(2*np.pi))    # quantizing binvalues in (0...16)
    bin_cells = bins[:10,:10], bins[10:,:10], bins[:10,10:], bins[10:,10:]
    mag_cells = mag[:10,:10], mag[10:,:10], mag[:10,10:], mag[10:,10:]
    hists = [np.bincount(b.ravel(), m.ravel(), bin_n) for b, m in zip(bin_cells, mag_cells)]
    hist = np.hstack(hists)     # hist is a 64 bit vector
    return hist

最后，和上一节的例子一样，我们将大图分割成小图。使用每个数字中的250 个作为训练数据，剩余250 个作为测试数据。

代码如下

# -*- coding: cp936 -*-
import cv2 
import numpy as np
import glob
from matplotlib import pyplot as plt

SZ=20
bin_n = 16 # Number of bins
affine_flags = cv2.WARP_INVERSE_MAP|cv2.INTER_LINEAR

def deskew(img):
    m = cv2.moments(img)
    if abs(m['mu02']) < 1e-2:
        return img.copy()
    skew = m['mu11']/m['mu02']
    M = np.float32([[1, skew, -0.5*SZ*skew], [0, 1, 0]])
    img = cv2.warpAffine(img,M,(SZ, SZ),flags=affine_flags)
    return img

def hog(img):
    gx = cv2.Sobel(img, cv2.CV_32F, 1, 0)
    gy = cv2.Sobel(img, cv2.CV_32F, 0, 1)
    mag, ang = cv2.cartToPolar(gx, gy)
    bins = np.int32(bin_n*ang/(2*np.pi))    # quantizing binvalues in (0...16)
    bin_cells = bins[:10,:10], bins[10:,:10], bins[:10,10:], bins[10:,10:]
    mag_cells = mag[:10,:10], mag[10:,:10], mag[:10,10:], mag[10:,10:]
    hists = [np.bincount(b.ravel(), m.ravel(), bin_n) for b, m in zip(bin_cells, mag_cells)]
    hist = np.hstack(hists)     # hist is a 64 bit vector
    return hist

img = cv2.imread('digits.png',0)
if img is None:
    raise Exception("we need the digits.png image from samples/data here !")
cells = [np.hsplit(row,100) for row in np.vsplit(img,50)]

# First half is trainData, remaining is testData
train_cells = [ i[:50] for i in cells ]
test_cells = [ i[50:] for i in cells]
deskewed = [list(map(deskew,row)) for row in train_cells]
hogdata = [list(map(hog,row)) for row in deskewed]
trainData = np.float32(hogdata).reshape(-1,64)
responses = np.repeat(np.arange(10),250)[:,np.newaxis]

svm = cv2.ml.SVM_create()
svm.setKernel(cv2.ml.SVM_LINEAR)
svm.setType(cv2.ml.SVM_C_SVC)
svm.setC(2.67)
svm.setGamma(5.383)
svm.train(trainData, cv2.ml.ROW_SAMPLE, responses)
svm.save('svm_data.dat')

deskewed = [list(map(deskew,row)) for row in test_cells]
hogdata = [list(map(hog,row)) for row in deskewed]
testData = np.float32(hogdata).reshape(-1,bin_n*4)
result = svm.predict(testData)[1]
mask = result==responses
correct = np.count_nonzero(mask)
print(correct*100.0/result.size)

图片用的和上一节一样。SVM算法的运行准确率是93.8。kNN算法一节中运行的准确率是91.76。
你可以尝试一下不同参数值的SVM，看看能不能达到更高的准确率。