http://sugiyama-www.cs.titech.ac.jp/~sugi/software/
Software
The software available below is free of charge for research and education purposes. However, you must obtain a license from the author(s) to use it for commercial purposes. The software must not be distributed without prior permission of the author(s).The software is supplied "as is" without warranty of any kind, and the author(s) disclaim any and all warranties, including but not limited to any implied warranties of merchantability and fitness for a particular purpose, and any warranties or non infringement. The user assumes all liability and responsibility for use of the software and in no event shall the author(s) be liable for damages of any kind resulting from its use.
Fundamentals
- Density ratio estimation
- KLIEP (Kullback-Leibler importance estimation procedure): MATLAB
- GM-KLIEP (Gaussian-mixture KLIEP): MATLAB (by Makoto Yamada)
- LSIF (least-squares importance fitting): R (by Takafumi Kanamori)
- uLSIF (unconstrained LSIF): MATLAB, R (by Takafumi Kanamori), C++ (by Issei Sato)
- RuLSIF (relative uLSIF): MATLAB (by Makoto Yamada), R (by Max Wornowizki), Python (by Song Liu)
- Density difference estimation
- LSDD (least-squares density difference): MATLAB
- Density derivative estimation
- LSLDG (least-squares log-density gradient): MATLAB (by Hiroaki Sasaki)
- Mutual information estimation
- MLMI (maximum-likelihood mutual information): MATLAB (with Taiji Suzuki)
- LSMI (least-squares mutual information): MATLAB (with Taiji Suzuki)
- LSMI (multiplicative kernel model): MATLAB (by Tomoya Sakai)
- Hetero-distributional subspace search
- LHSS (least-squares hetero-distributional search): MATLAB (with Makoto Yamada)
Applications
- Covariate shift adaptation
- IWLS+IWCV+uLSIF (importance-weighted least-squares + importance-weighted cross-validation + unconstrained least-squares importance fitting): MATLAB
- IWLR+KLIEP (importance-weighted logistic regression + Kullback-Leibler importance estimation procedure): MATLAB (by Makoto Yamada)
- IWLSPC+IWCV+KLIEP (importance-weighted least-squares probabilistic classifier + importance-weighted cross-validation + Kullback-Leibler importance estimation procedure): MATLAB (by Hirotaka Hachiya)
- Class prior change adaptation
- uLSIF-based method: MATLAB (by Marthinus Christoffel du Plessis)
- LSDD-based method: MATLAB (by Marthinus Christoffel du Plessis)
- Inlier-based outlier detection
- MLOD (maximum-likelihood outlier detection): MATLAB
- LSOD (least-squares outlier detection): MATLAB
- LSAD (least-squares anomaly detection): Python (by John Quinn)
- Feature selection
- MLFS (maximum-likelihood feature selection in supervised regression/classification): MATLAB (with Taiji Suzuki)
- LSFS (least-squares feature selection in supervised regression/classification): MATLAB (with Taiji Suzuki)
- L1-LSMI (L1-LSMI-based feature selection for supervised regression/classification): MATLAB (by Wittawat Jitkrittum)
- HSIC-LASSO (Hilbert-Schmidt independence criterion + least absolute shrinkage and selection operator for high-dimensional feature selection in supervised regression/classification): MATLAB (by Makoto Yamada)
- Dimensionality reduction/feature extraction/metric learning
- NGCA (non-Gaussian component analysis, unsupervised linear dimensionality reduction): MATLAB (by Gilles Blanchard)
- LSDR (least-squares dimensionality reduction, supervised linear dimensionality reduction for regression/classification): MATLAB (with Taiji Suzuki)
- SCA (sufficient component analysis, supervised linear dimensionality reduction for regression/classification):MATLAB (by Makoto Yamada)
- LFDA (local Fisher discriminant analysis, supervised linear dimensionality reduction for classification): MATLAB
- KLFDA (kernel LFDA, supervised non-linear dimensionality reduction for classification): MATLAB
- SELF (semi-supervised LFDA, semi-supervised linear dimensionality reduction for classification): MATLAB
- LSCDA (least-squares canonical dependency analysis, linear dimensionality reduction for paired data): MATLAB (by Masayuki Karasuyama)
- SERAPH (semi-supervised metric learning paradigm with hyper-sparsity, semi-supervised metric learning for classification): MATLAB (by Gang Niu)
- Conditinonal probability estimation
- LSCDE (least-squares conditional density estimation): MATLAB
- LSPC (least-squares probabilitic classifier): MATLAB, Python (by John Quinn)
- SMIR (squared-loss mutual information regularization, semi-supervised probabilistic classification): MATLAB (by Gang Niu and by Wittawat Jitkrittum)
- Independence test
- LSIT (least-squares independence test): MATLAB
- Two-sample test
- LSTT (least-squares two-sample test): MATLAB
- Change detection
- CD-RuLSIF (distributional change detection by RuLSIF): MATLAB (by Song Liu)
- CD-KLIEP (structural change detection by sparse KLIEP): MATLAB (by Song Liu)
- Clustering
- Independent component analysis
- LICA (independent component analysis): MATLAB (by Taiji Suzuki)
- Causal direction inference
- LSIR (least-squares independence regression): MATLAB (by Makoto Yamada)
- Cross-domain object matching
- LSOM (least-squares object matching): MATLAB (by Makoto Yamada)
- Hidden Markov Model
- DRHMM (density-ratio hidden Markov model): MATLAB and Python (by John Quinn)
- Sparse learning
- DAL (l1/grouped-l1/trace-norm regularization solver): MATLAB (by Ryota Tomioka)
- Matrix factorization
- VBMF (variational Bayesian matrix factorization): MATLAB
- Reinforcement learning
- IW-PGPE-OB (model-free policy gradient method with sample reuse): MATLAB
Masashi Sugiyama (sugi [at] cs.titech.ac.jp)
Sugiyama Laboratory, Department of Computer Science,
Graduate School of Information Science and Engineering, Tokyo Institute of Technology,
2-12-1-W8-74, O-okayama, Meguro-ku, Tokyo, 152-8552, Japan.
TEL & FAX: +81-3-5734-2699