python清洗数据去除停用词_Python从pandas数据帧中删除停用词

我想从我的专栏“tweets”中删除停用词.如何迭代每一行和每个项目？

pos_tweets = [('I love this car', 'positive'),

('This view is amazing', 'positive'),

('I feel great this morning', 'positive'),

('I am so excited about the concert', 'positive'),

('He is my best friend', 'positive')]

test = pd.DataFrame(pos_tweets)

test.columns = ["tweet","class"]

test["tweet"] = test["tweet"].str.lower().str.split()

from nltk.corpus import stopwords

stop = stopwords.words('english')

解决方法:

使用列表理解

test['tweet'].apply(lambda x: [item for item in x if item not in stop])

返回：

0 [love, car]

1 [view, amazing]

2 [feel, great, morning]

3 [excited, concert]

4 [best, friend]

标签：python,pandas

来源： https://codeday.me/bug/20190926/1821562.html