【语言分析】看看我为了不写英语作业都做了些什么

最新推荐文章于 2024-08-31 19:43:08 发布

CristinaM

最新推荐文章于 2024-08-31 19:43:08 发布

阅读量184

点赞数

分类专栏：基础资料

本文链接：https://blog.csdn.net/weixin_43615654/article/details/103544221

版权

资料同时被 2 个专栏收录

20 篇文章 1 订阅

订阅专栏

基础

10 篇文章 1 订阅

订阅专栏

Text Mining in Python: Steps and Examples

词性标注（Part-of-speech tagging）

词性标注（Part-of-speech tagging）
(自然语言处理文档系列)Penn Treebank词性标记集

import pandas as pd
import numpy as np

import os
import nltk.corpus
from nltk.tokenize import word_tokenize

text = 'Despite the popularity of the term, sociologists have ignored gaslighting, leaving it to be theorized by psychologists'
tex = word_tokenize(text)
for token in tex:
    print(nltk.pos_tag([token]))

[('Despite', 'IN')]
[('the', 'DT')]
[('popularity', 'NN')]
[('of', 'IN')]
[('the', 'DT')]
[('term', 'NN')]
[(',', ',')]
[('sociologists', 'NNS')]
[('have', 'VB')]
[('ignored', 'VBN')]
[('gaslighting', 'VBG')]
[(',', ',')]
[('leaving', 'VBG')]
[('it', 'PRP')]
[('to', 'TO')]
[('be', 'VB')]
[('theorized', 'VBN')]
[('by', 'IN')]
[('psychologists', 'NNS')]