example for document classify use nltk and python

最新推荐文章于 2023-08-04 00:36:10 发布

warrior_zhang

最新推荐文章于 2023-08-04 00:36:10 发布

阅读量465

点赞数

分类专栏： python nlp 文章标签： linux python nlp nltk

版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。

本文链接：https://blog.csdn.net/warrior_zhang/article/details/50503381

版权

python 同时被 2 个专栏收录

18 篇文章 0 订阅

订阅专栏

3 篇文章 0 订阅

订阅专栏

1. get the movie comment and classify it into pos or neg
code like below:

点击(此处)折叠或打开

>>> import nltki
>>> import random
>>> from nltk.corpus import movie_reviews
>>> documents = [(list(movie_reviews.words(fileid)), category)
... for category in movie_reviews.categories()
... for fileid in movie_reviews.fileids(category)]
>>> random.shuffle(documents)

2.get the features of the documents, that if the word in the selected document
code like below:

点击(此处)折叠或打开

>>> all_words = nltk.FreqDist(w.lower() for w in movie_reviews.words())
>>> word_features = all_words.keys()[:2000]
>>> def document_features(document):
... document_words = set(document)
... features = {}
... for word in word_features:
... features['contains(%s)' % word] = (word in document_words)
... return features

3.train and test the classifier for the document
code like below:

点击(此处)折叠或打开

>>> featuresets = [(document_features(d), c) for (d,c) in documents]
>>> train_set, test_set = featuresets[100:], featuresets[:100]
>>> classifier = nltk.NaiveBayesClassifier.train(train_set)
>>> print nltk.classify.accuracy(classifier, test_set)
0.73

关注

0
点赞
踩
0

收藏

觉得还不错? 一键收藏
0
评论
example for document classify use nltk and python

example for document classify use nltk and python1. get the movie comment and classify it into pos or neg
复制链接

扫一扫

专栏目录

评论

被折叠的条评论为什么被折叠?

到【灌水乐园】发言

查看更多评论

添加红包

成就一亿技术人!

hope_wisdom

发出的红包

实付元

使用余额支付

点击重新获取

扫码支付

钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。