机器学习概要提纲

ML

Toolbox

java

- Mahout
- Weka
- Mallet
- JSAT

Python

- Scikit-learn
- PyBrain
- nltk
- Theano
- Pylearn2
- MDP
- Orange
- milk
- pyml
- Numpy

Matlab

Real-time Computation Paltform

Spark

- MLlib

Hurricane

- SewedBIAS

Storm

Heron

Algorithms

Supervised Learning

Regression

- Generalized Linear Regression
- Gaussian Processes
- Isotonic Regression

Classification

- Support Vector Machines (SVM)
- Linear and Quadratic Discriminant Analysis
- Decision Trees
- K Nearest Neighbors
- Naive Bayes
- Neural Networks
- Ensemble Methods
- Kernel Approximation
- Adaboost

Unsupervised Learning

Clustering

- K-Means
- Gaussian Mixture Models
- Spectral Clustering
- Manifold Learning
- Hierarchical Clustering
- Affinity Propagation
- DBSCAN
- Birch

Dimensionality Reduction

- Principal Component Analysis
- Linear Discriminant Analysis
- Locally linear embedding
- Laplacian Eigenmaps
- Isomap
- Spectral Embedding
- Feature Agglomeration

Reinforcement Learning

- Markov Decision Processes
- Q-Learning
- Sarsa
- A-Learning

Deep Learning

- Convolutional Neural Network (CNN)
- Restricted Boltzmann Machines
- Recurrent Neural Network (RNN)
    - Long Short Term Memory

Model Selection and Evaluation

Cross-validation

Grid Search

Model Evaluation

Model Persistence

Validation Curves

Frameworks

TensorFlow

Caffe2/Caffe

Theano

Torch

Chainer

OpenBLAS

CUDA

CUDNN