模式识别

Pattern Recognition

A pattern is the opposite of chaos. It is an entity, vaguely defined, that could be given a name, such as human face, fingerprint image, handwritten word and so on. A pattern is an abstract object, such as a set of measurements describing a physical object. Pattern recognition is the study of how machines can:

• Observe the environment
• Learn to distinguish patterns of interest
• Make reasonable decisions about the categories of patterns

Hunger: 模式识别是把一类事物通过特征来描述，根据特征训练出一个模型，使用模型可以判别出事物的类别，同一类的事物具有相似的“模式”。模式识别可以应用的领域很多，包括：经济领域、计算机科学领域、生物领域等等。

Bayesian Decision Theory

Bayes Formula：posterior = likelihood * prior / evidence

Bayes Rule

Probability of Error：判定为某一类别的错误率 = 1 - 该类别的概率

Bayes Risk

Given observation x, if the true state is omiga, and we take action alpha, then loss is lambda.

Loss Function     Minimum Risk Decision Rule     Minimum-Error-Rate Classification

Hunger: 贝叶斯决策理论是根据贝叶斯公式求似然概率，作为类别判断的依据。考虑决策代价是将误判的代价乘以真实状况的概率