python读取文本中的英文_利用Python将文本中的中英文分离方法

在进行文本分析、提取关键词时，新闻评论等文本通常是中英文及其他语言的混杂，若不加处理直接分析，结果往往差强人意。

下面对中英文文本进行分离做一下总结：

1、超短文本，ascii识别。

s = "china's legend holdings will split its several business arms to go public on stock markets, the group's president zhu linan said on tuesday.该集团总裁朱利安周二表示，中国联想控股将分拆其多个业务部门在股市上市。"

result = "".join(i for i in s if ord(i) < 256)

print(result)

out:

china's legend holdings will split its several business arms to go public on stock markets, the group's president zhu linan said on tuesday.

2、unicode编码识别

import re

s = "china's legend holdings will split its several business arms to go public on stock markets, the group's president zhu linan said on tuesday.该集团总裁朱利安周二表示，中国联想控股将分拆其多个业务部门在股市上市。"

uncn = re.compile(r'[\u0061-\u007a,\u0020]')

e