jieba分词

import jieba
excludes={"到底","这会子","一句","原来","家里","姊妹","一声","不得","妹妹","不用","看见","媳妇","听说","人家","如何","小丫头","问道","那些","屋里","罢了","今儿","一回","这话","外头","自然","打发","哪里","这么","几个","还有","二爷","只管","说话","那边","太太","两个","听见","丫头","姐姐","的话","不能","心里","她们","如此","银子","今日","二人","答应","一时","过来","所以","不敢","出去","不过","不好","他们","这些","只得","告诉","奶奶","一个","你们","出来","那里","只是","大家","姑娘","知道","起来","这里","如今","说道","我们","什么","一面","只见","这样","怎么","不是","不知","这个","众人","东西","进来","没有","咱们","回来","就是","自己"}
txt=open("红楼梦.txt","r",encoding='utf-8').read()
words=jieba.lcut(txt)
counts={}
rword=0
for word in words:
    if len(word)==1:
        continue
    elif word=="老太太"or word=="老奶奶":
        rword="贾母"
    elif word=="老爷":
        rword="贾琏"
    elif word=="王熙凤"or word=="王夫人"or word=="凤姐儿":
        rword="凤姐"
    else:
        rword=word
  
    counts[rword]=counts.get(rword,0)+1
for word in excludes:
    del(counts[word])
items=list(counts.items())
items.sort(key=lambda x:x[1],reverse=True)
for i in range(20):
    word,count=items[i]
    print("{0:<10}{1:>5}".format(word,count))

  • 10
    点赞
  • 17
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值