网络爬虫遇见的报错及处理方法

0.环境介绍

1. pip install psutil出错-You are using pip version 10.0.1, however version 18.0 is available.

2. 使用BeautifulSoup的时候提示以下错误：bs4.FeatureNotFound: Couldn't find a tree builder with the features you requested: html5lib. Do you need to install a parser library?

3.bs4.FeatureNotFound: Couldn't find a tree builder with the features you requested: lxml. Do you need to install a parser library?

---

---

0.环境介绍

python 3.6+Atom编辑器+windows powershell+Firefox浏览器

 

1. pip install psutil出错-You are using pip version 10.0.1, however version 18.0 is available.

转自：https://www.cnblogs.com/sincoolvip/p/9522232.html

网络爬虫安装Selenium模块时遇见报错如上

解决方案：更新pip        python -m pip install --upgrade pip 

 

2. 使用BeautifulSoup的时候提示以下错误：bs4.FeatureNotFound: Couldn't find a tree builder with the features you requested: html5lib. Do you need to install a parser library?

转自：https://blog.csdn.net/sinat_36246371/article/details/62425962 

解决方案：pip install html5lib

 

3.bs4.FeatureNotFound: Couldn't find a tree builder with the features you requested: lxml. Do you need to install a parser library?

转自：https://blog.csdn.net/weixin_38620636/article/details/80727081 

解决方案：

1、首先执行 pip install wheel

2、pip install lxml     输入之后会显示下载的网页路径，复制直接在浏览器下载，因为下载比较慢，在dos中下载会出现timeout错误。

3、下载完成直接安装就可以的。