稀疏编码及其改进（ScSPM，LLC，super-vector coding）

1 稀疏表达说起

http://blog.sciencenet.cn/blog-261330-808758.html

这里面追本溯源的介绍为什么要进行稀疏表达以及数学优化表达式的推导过程，通俗易懂，适合入门。

稀疏编码的改进

2 深入稀疏编码

http://www.cnblogs.com/tornadomeet/archive/2013/04/14/3019885.html

系列文章Deep learning：二十六(Sparse coding简单理解)

Deep learning：二十七(Sparse coding中关于矩阵的范数求导)

Deep learning：二十八(使用BP算法思想求解Sparse coding中矩阵范数导数)

原理部分解释很清楚。

3 实现

Deep learning：二十九(Sparse coding练习)

或者下载 目前最常用的是Spams 的函数包。下载地址： http://spams-devel.gforge.inria.fr/

 4 改进

4.1 ScSPM

Linear Spatial PyramidMatchingusing Sparse Coding for Image Classification (CVPR'09)

An extension of the SPMmethod, bygeneralizing vector quantization to sparse coding followed bymulti-scalespatial {max pooling}, and propose a linear SPM kernel based onSIFT sparsecodes. This new approach remarkably reduces the complexity of SVMsto O(n) intraining and a constant in testing. In a number of imagecategorizationexperiments, we find that, in terms of classification accuracy,the suggestedlinear SPM based on sparse coding of SIFT descriptors alwayssignificantlyoutperforms the linear SPM kernel on histograms, and is evenbetter than thenonlinear SPM kernels, leading to state-of-the-art performanceon severalbenchmarks by using a single type of descriptors.

The algorithm is composed of the following parts:

a. SIFTdescriptorextraction.
b. Sparse coding. WeintegratedHonglak Lee's Matlabcodes fordictionary learning.
d. Linear SVMclassification. Weimplemented an efficient linear SVM with squared hinge lossfunction.