factor是对于variables的某种combination的fitness。在BN中factor就是conditional probability distribution(CPD);但factor并不总对应着某种概率(当然也不一定取0~1),比如说在MRF中。和数据库table的操作类似,factor上的基本操作有factor product ,factor marginalization & factor reduction。实际中最常用的模型大概是含有shared structure和shared parameters的模型,比如说NLP里面的sequence model,举一个做Named entity recognition的例子,联系着latent变量的参数(type of entity),是independent of the place and the sequence的(假设position in the sequence与参数无关),这样的好处是:
reuse of parameters allow us to apply the same model to sequences of varying length Template models are languages that specify how variables inherit dependency model from template(representation that allows us to solve multiple problems using the same exact model)
Factor Graph 是概率图的一种,