Three main active learning scenarios
Membership query synthesis:
The learner may request labels for any unlabeled instance in the input space.
Uncertainty sampling:
An active learner queries the instances about which it is least certain how to label
Entropy
单个分类器:
熵大小
多个分类器 Query - by - committee:
通过投票决定instance they most disagree
minimizing the version space
1. be able to construct a committee of models that represent different regions of the version space
2.have some measure of disagreement among committee members
vote entropy/average Kullback- Lwiblwe(KL) divergence
3.3 expected model change
增加那些知道label后