《三国演义》人物出场统计

人物出场统计涉及对词汇的统计。中文文章需要分词才能进行词频统计。这就需要用到jieba库。

实现代码1：

#三国演义 人物出场统计
import jieba
txt=open("threekingdoms1.txt","r",encoding='utf-8').read()
words=jieba.lcut(txt)
counts={}
for word in words:
    if len(word)==1: #排除单个字符的分词结果
        continue
    else:
        counts[word]=counts.get(word,0)+1
items=list(counts.items())
items.sort(key=lambda x:x[1],reverse=True)
for i in range(15):
    word,count=items[i]
    print("{0:<10}{1:>5}".format(word,count))

结果如下：

下面对代码进行升级，使之能够对文本做更进一步的处理：

#三国演义 人物出场统计升级版
import jieba
excludes={"将军","却说","二人","不可","荆州","不能","如此"}
txt=open("threekingdoms1.txt","r",encoding='utf-8').read()
words=jieba.lcut(txt)
counts={}
for word in words:
    if len(word)==1: #排除单个字符的分词结果
        continue
    elif word=="诸葛亮" or word=="孔明曰":
        rword="孔明"
    elif word=="关公" or word=="云长":
        rword="关羽"
    elif word=="玄德" or word=="玄德曰":
        rword="刘备"
    elif word=="翼德":
        rword="张飞"
    elif word=="孟德" or word=="丞相":
        rword="曹操"
    else:
        rword=word
    counts[rword]=counts.get(rword,0)+1
for word in excludes:
    del(counts[word])
items=list(counts.items())
items.sort(key=lambda x:x[1],reverse=True)
for i in range(20):
    word,count=items[i]
    print("{0:<10}{1:>5}".format(word,count))
    

结果如下：

经过多次修改代码得到最终结果：

#三国演义 人物出场统计升级版
import jieba
excludes={"将军","却说","二人","不可","荆州","不能","如此","商议","如何","主公","次日",\
          "军士","左右","军马","引兵","大喜","天下","东吴","于是","今日","不敢","魏兵"\
          ,"陛下","一人","都督","人马","不知","汉中","只见","众将","后主","蜀兵",\
          "上马","大叫","太守","此人","夫人","先主","后人","背后","城中","天子","一面",\
          "何不","大军","忽报","先生","百姓","何故","然后","先锋","不如","赶来","原来",\
          "令人","江东","下马","喊声","正是","徐州","忽然","因此","成都","不见","未知",\
          "大败","大事","之后","一军","引军","起兵","军中","接应","进兵","大惊","可以",\
          "以为","大怒","不得","心中","下文","一声","追赶"}
txt=open("threekingdoms1.txt","r",encoding='utf-8').read()
words=jieba.lcut(txt)
counts={}
for word in words:
    if len(word)==1: #排除单个字符的分词结果
        continue
    elif word=="诸葛亮" or word=="孔明曰" or word=="卧龙先生":
        rword="孔明"
    elif word=="关公" or word=="云长":
        rword="关羽"
    elif word=="玄德" or word=="玄德曰":
        rword="刘备"
    elif word=="翼德":
        rword="张飞"
    elif word=="孟德" or word=="丞相":
        rword="曹操"
    else:
        rword=word
    counts[rword]=counts.get(rword,0)+1
for word in excludes:
    del(counts[word])
items=list(counts.items())
items.sort(key=lambda x:x[1],reverse=True)
for i in range(20):
    word,count=items[i]
    print("{0:<10}{1:>5}".format(word,count))
    

最终结果如下：