自然语言处理(NLP) 三：词袋模型 + 文本分类

最新推荐文章于 2023-06-11 02:05:28 发布

爱跑步的george

最新推荐文章于 2023-06-11 02:05:28 发布

阅读量6.8k

点赞数

分类专栏：自然语言处理

本文链接：https://blog.csdn.net/weixin_38246633/article/details/80638791

版权

1.词袋模型

（BOW,bag of words)
用词频矩阵作为每个样本的特征
Are you curious about tokenization ? Let’s see how it works! we need to analyze a couple of sentences with puntuations to see it in action.’
每个单词出现的次数

import nltk.tokenize as tk 
import sklearn.feature_extraction.text as ft 
#ft进行特征抓取
doc = 'the brown dog is running. The black dog is in the black room. Running in the room is forbidden.'
print(doc)
print('-'*