-----------------------------------------
--- MATLAB/OCTAVE interface of LIBSVM ---
-----------------------------------------
Table of Contents
=================
- Introduction------------------------------介绍
- Installation-------------------------------安装
- Usage-------------------------------------使用
- Returned Model Structure--------------返回的模型结构
- Other Utilities----------------------------其他实用工具
- Examples---------------------------------例子
- Additional Information------------------附加信息
Introduction
============
介绍就不说了，就是支持向量机工具箱，易用，而且是灰常易用！
Installation
============
On Windows systems, pre-built binary files are already in the
directory '..\windows', so
no need to conduct installation. Now we
provide binary files only for 64bit MATLAB on Windows. If you would
like to re-build the package, please rely on the following steps.
在
Windows平台上，可以到目录'..\windows'中直接使用，
不需要安装。
里面的数据预处理可以帮助了解LibSVM。
我的操作，数据集是下面例子中的heart_scale(MatLab的LIBSVM自带的)：
数据不用归一化处理的话，两条命令就搞定了。
D:\Program Files\MATLAB\R2013a\toolbox\libsvm-3.20\windows>
svm-train.exe ../heart_scale hmodel.model
其中hmodel.model是训练好的模型（分类器）名，由自己指定，供预测(即 svm-predict.exe)用。
*
optimization finished, #iter = 162
nu = 0.431029
obj = -100.877288, rho = 0.424462
nSV = 132, nBSV = 107
Total nSV = 132
D:\Program Files\MATLAB\R2013a\toolbox\libsvm-3.20\windows>
svm-predict.exe ../heart_scale hmodel.model test0.txt
Accuracy = 86.6667% (234/270) (classification)
其中，test0.txt是结果输出文件，名字由自己指定。
若非要安装，只提供了64位的，自行编译。
具体安装步骤如下：
We recommend using make.m on both MATLAB and OCTAVE. Just type 'make'
to build 'libsvmread.mex', 'libsvmwrite.mex', 'svmtrain.mex', and
'svmpredict.mex'.
On MATLAB or Octave:
>> make
If make.m does not work on MATLAB (especially for Windows), try 'mex
-setup' to choose a suitable compiler for mex. Make sure your compiler
is accessible and workable. Then type 'make' to start the
installation.
Example:
matlab>> mex -setup
(ps: MATLAB will show the following messages to setup default compiler.)
Please choose your compiler for building external interface (MEX) files:
Would you like mex to locate installed compilers [y]/n? y
Select a compiler:
[1] Microsoft Visual C/C++ version 7.1 in C:\Program Files\Microsoft Visual Studio
[0] None
Compiler: 1
Please verify your choices:
Compiler: Microsoft Visual C/C++ 7.1
Location: C:\Program Files\Microsoft Visual Studio
Are these correct?([y]/n): y
matlab>> make
On Unix systems, if neither make.m nor 'mex -setup' works, please use
Makefile and type 'make' in a command window. Note that we assume
your MATLAB is installed in '/usr/local/matlab'. If not, please change
MATLABDIR in Makefile.
Example:
linux> make
To use octave, type 'make octave':
Example:
linux> make octave
For a list of supported/compatible compilers for MATLAB, please check
the following page:
http://www.mathworks.com/support/compilers/current_release/
Usage
=====
在Windows平台上，使用cd到'..\windows'目录下(我的放在了
MatLab的toolbox目录下，最好将下载的工具箱解压复制到matlab的toolbox文件夹下，众多网友的建议)，输入对应的exe文件，后面跟上下面matlab所写的参数，比如：
D:\Program Files\MATLAB\R2013a\toolbox\libsvm-3.20\windows>svm-train.exe model =
svmtrain(training_label_vector, training_instance_matrix [, 'libsvm_options'])
下面遵循文档:
matlab> model =
svmtrain(training_label_vector, training_instance_matrix [, 'libsvm_options']);
-training_label_vector:
An m by 1 vector of training labels (type must be double).
-training_instance_matrix:
An m by n matrix of m training instances with n features.
It can be dense or sparse (type must be double).
-libsvm_options:
A string of training options in the same format as that of LIBSVM.
matlab> [predicted_label, accuracy, decision_values/prob_estimates] =
svmpredict(testing_label_vector, testing_instance_matrix, model [, 'libsvm_options']);
matlab> [predicted_label] = svmpredict(testing_label_vector, testing_instance_matrix, model [, 'libsvm_options']);
-testing_label_vector:
An m by 1 vector of prediction labels. If labels of test
data are unknown, simply use any random values. (type must be double)
-testing_instance_matrix:
An m by n matrix of m testing instances with n features.
It can be dense or sparse. (type must be double)
-model:
The output of svmtrain.
-libsvm_options:
A string of testing options in the same format as that of LIBSVM.
Returned Model Structure
========================
返回的模型结构，
即svmtrain的结构(所包含的参数或者属性)。
The 'svmtrain' function returns a model which can be used for future
prediction. It is a structure and is organized as [Parameters, nr_class,
totalSV, rho, Label, ProbA, ProbB, nSV, sv_coef, SVs]:
-Parameters: parameters
-nr_class: number of classes; = 2 for regression/one-class svm
-totalSV: total #SV
-rho: -b of the decision function(s) wx+b
-Label: label of each class; empty for regression/one-class SVM
-sv_indices: values in [1,...,num_traning_data] to indicate SVs in the training set
-ProbA: pairwise probability information; empty if -b 0 or in one-class SVM
-ProbB: pairwise probability information; empty if -b 0 or in one-class SVM
-nSV: number of SVs for each class; empty for regression/one-class SVM
-sv_coef: coefficients for SVs in decision functions
-SVs: support vectors
If you do not use the option '-b 1', ProbA and ProbB are empty
matrices. If the '-v' option is specified, cross validation is
conducted and the returned model is just a scalar: cross-validation
accuracy for classification and mean-squared error for regression.
More details about this model can be found in LIBSVM FAQ
(http://www.csie.ntu.edu.tw/~cjlin/libsvm/faq.html) and LIBSVM
implementation document
(http://www.csie.ntu.edu.tw/~cjlin/papers/libsvm.pdf).
Result of Prediction
====================
结果预测，
svmpredict包括三个输出。
1.预测标签；
2.精确度(for classification)；
3.一个包含决策值或者概率估计的矩阵；
The function 'svmpredict' has three outputs. The first one,
predictd_label, is a vector of predicted labels. The second output,
accuracy, is a vector including accuracy (for classification), mean
squared error, and squared correlation coefficient (for regression).
The third is a matrix containing
decision values or
probability
estimates (if '-b 1' is specified). If k is the number of classes
in training data, for decision values, each row includes results of
predicting k(k-1)/2 binary-class SVMs. For classification, k = 1 is a
special case. Decision value +1 is returned for each testing instance,
instead of an empty vector. For probabilities, each row contains k values
indicating the probability that the testing instance is in each class.
Note that the order of classes here is the same as 'Label' field
in the model structure.
Other Utilities
===============
其他实用的工具，就是文件读写，
libsvmread 可将txt文件转为LIBSVM格式文件，
libsvmwrite将MatLab矩阵写入一个文件。
A matlab function libsvmread reads files in LIBSVM format:
[label_vector, instance_matrix] =
libsvmread('data.txt');
Two outputs are labels and instances, which can then be used as inputs
of svmtrain or svmpredict.
A matlab function libsvmwrite writes Matlab matrix to a file in LIBSVM format:
libsvmwrite('data.txt', label_vector, instance_matrix)
The instance_matrix must be a sparse matrix. (type must be double)
For 32bit and 64bit MATLAB on Windows, pre-built binary files are ready
in the directory `..\windows', but in future releases, we will only
include 64bit MATLAB binary files.
These codes are prepared by Rong-En Fan and Kai-Wei Chang from National
Taiwan University.
Examples
========
Train and test on the provided data heart_scale:
例子，在提供的
heart_scale(老版本的LIBSVM可能叫heart_scale.mat)数据上训练和测试。
heart_scale，一共270个样本(记录)，标签为+1和-1。
matlab> [heart_scale_label, heart_scale_inst] =
libsvmread('../heart_scale');
matlab> model =
svmtrain(heart_scale_label, heart_scale_inst, '-c 1 -g 0.07');
matlab> [predict_label, accuracy, dec_values] =
svmpredict(heart_scale_label, heart_scale_inst, model); % test the training data
For
probability estimates, you need '-b 1' for training and testing:
matlab> [heart_scale_label, heart_scale_inst] =
libsvmread('../heart_scale');
matlab> model =
svmtrain(heart_scale_label, heart_scale_inst, '-c 1 -g 0.07 -b 1');
matlab> [heart_scale_label, heart_scale_inst] =
libsvmread('../heart_scale');
matlab> [predict_label, accuracy, prob_estimates] =
svmpredict(heart_scale_label, heart_scale_inst, model, '-b 1');
To use precomputed kernel, you must include
sample serial number as
the first column of the training and testing data (assume your kernel
matrix is K, # of instances is n):
matlab> K1 = [(1:n)', K]; % include sample serial number as first column
matlab> model =
svmtrain(label_vector, K1, '-t 4');
matlab> [predict_label, accuracy, dec_values] =
svmpredict(label_vector, K1, model); % test the training data
We give the following detailed example by splitting heart_scale into
150 training and 120 testing data. Constructing a linear kernel
matrix and then using the precomputed kernel gives exactly the same
testing error as using the LIBSVM built-in linear kernel.
matlab> [heart_scale_label, heart_scale_inst] =
libsvmread('../heart_scale');
matlab>
matlab> %
Split Data
matlab> train_data = heart_scale_inst(1:150,:);
matlab> train_label = heart_scale_label(1:150,:);
matlab> test_data = heart_scale_inst(151:270,:);
matlab> test_label = heart_scale_label(151:270,:);
matlab>
matlab> %
Linear Kernel
matlab> model_linear =
svmtrain(train_label, train_data, '-t 0');
matlab> [predict_label_L, accuracy_L, dec_values_L] =
svmpredict(test_label, test_data, model_linear);
matlab>
matlab> % Precomputed Kernel
matlab> model_precomputed =
svmtrain(train_label, [(1:150)', train_data*train_data'], '-t 4');
matlab> [predict_label_P, accuracy_P, dec_values_P] =
svmpredict(test_label, [(1:120)', test_data*train_data'], model_precomputed);
matlab>
matlab>
accuracy_L % Display the accuracy using linear kernel
matlab>
accuracy_P % Display the accuracy using precomputed kernel
Note that for testing, you can put anything in the
testing_label_vector. For more details of precomputed kernels, please
read the section ``Precomputed Kernels'' in the README of the LIBSVM
package.
Additional Information
======================
This interface was initially written by Jun-Cheng Chen, Kuan-Jen Peng,
Chih-Yuan Yang and Chih-Huai Cheng from Department of Computer
Science, National Taiwan University. The current version was prepared
by Rong-En Fan and Ting-Fan Wu. If you find this tool useful, please
cite LIBSVM as follows
Chih-Chung Chang and Chih-Jen Lin, LIBSVM : a library for support
vector machines. ACM Transactions on Intelligent Systems and
Technology, 2:27:1--27:27, 2011. Software available at
http://www.csie.ntu.edu.tw/~cjlin/libsvm
For any question, please contact Chih-Jen Lin ,
or check the FAQ page:
http://www.csie.ntu.edu.tw/~cjlin/libsvm/faq.html#/Q10:_MATLAB_interface
扫一扫
236
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
