可读性计算方法参考:
https://python.ctolib.com/cdimascio-py-readability-metrics.html
Python textstat包介绍(包括各种指标的计算公式):
https://pypi.org/project/textstat/
可读性计算方法有
The Flesch Reading Ease formula
Flesch-Kincaid Grade Level
The Fog Scale (Gunning FOG Formula)
The SMOG Index
Automated Readability Index
The Coleman-Liau Index
Linsear Write Formula
Dale-Chall Readability Score
本文选取FOG、ARI、CLI
准备
安装包 textstat
pip install textstat
导入包
import pandas as pd
import textstat
读入数据
Idea=pd.read_csv(r"E:\IdeasTest.csv" )
i=len(Idea)
print(i)
计算文档可读性并写入csv
content=[]
for x in range(0,i):
j=Idea['Ideas'][x]
#print(j)
ID=Idea['userid'][x]
FOG=textstat.gunning_fog(j)
ARI=textstat.automated_readability_index(j)
CLI=textstat.coleman_liau_index(j)
mean=(FOG+ARI+CLI)/3
content.append([ID,FOG,ARI,CLI,mean])
dd=pd.DataFrame(content,columns=['ID','FOG','ARI','CLI','mean'])
dd.to_csv(r"E:\readability.csv")