【文本清洗/编码解码转换】将从网页爬取的数据中含有以&#开头的乱码，转为可读的字符串

最新推荐文章于 2023-06-14 14:25:05 发布

一只小榨菜

最新推荐文章于 2023-06-14 14:25:05 发布

阅读量476

点赞数

分类专栏： python 文章标签： python 爬虫自然语言处理

本文链接：https://blog.csdn.net/qq_43655453/article/details/129278456

版权

本文针对爬虫获取的文本中出现的以 '&#' 开头的乱码问题进行探讨，旨在通过处理函数将其转换为正常可读的字符串。内容包括问题描述、清洗目标以及实现转换的代码示例。

摘要由CSDN通过智能技术生成

问题描述

在对从网页爬取的字符串做处理时，发现掺杂了形如**&#712**的乱码，示例如下：

"Mother Mary Teresa Bojaxhiu[6] (born Anjez&#235; Gonxhe Bojaxhiu, Albanian: [a&#712;&#626;&#603;z&#601; &#712;&#609;&#596;nd&#658;&#603; b&#596;ja&#712;d&#658;iu]; 26 August 1910 &#8211; 5 September 1997), honoured in the Catholic Church as Saint Teresa of Calcutta,[7] was an Albanian-Indian[4] Roman Catholic nun and missionary."

清洗目标

"Mother Mary Teresa Bojaxhiu[6] (born Anjezë Gonxhe Bojaxhiu, Albanian: [aˈɲɛzə ˈɡɔndʒɛ bɔjaˈdʒiu]; 26 August 1910 – 5 September 1997), honoured in the Catholic Church as Saint Teresa of Calcutta,[7] was an Albanian-Indian[4] Roman Catholic nun and missionary."