爬虫-python网络数据收集学习-第3章-心得随笔20180419

按书上运行程序时出现问题：

from urllib.request import urlopen
from bs4 import BeautifulSoup

html = urlopen("https://www.baidu.com/")
bsObj = BeautifulSoup(html)
for link in bsObj.findAll("a"):
    if 'href' in link.atters:
        print(link.atters['href'])

报错为：

E:\practicework\scrapingtest\ll_env\lib\site-packages\bs4\__init__.py:181: UserWarning: No parser was explicitly specified, so I'm using the best available HTML parser for this system ("html.parser"). This usually isn't a problem, but if you run this code on another system, or in a different virtual environment, it may use a different parser and behave differently.

The code that caused this warning is on line 5 of the file test20170419.py. To get rid of this warning, change code that looks like this:

 BeautifulSoup(YOUR_MARKUP})

to this:

 BeautifulSoup(YOUR_MARKUP, "html.parser")

在bsObj行添加"html.parser"才能解决问题。

from urllib.request import urlopen
from bs4 import BeautifulSoup

html = urlopen("https://www.baidu.com/")
bsObj = BeautifulSoup(html,'html.parser')
for link in bsObj.findAll("a"):
    if 'href' in link.atters:
        print(link.atters['href'])

这是用来指定解析器。

遇到错误如：

TypeError: argument of type 'NoneType' is not iterable
'NoneType' object has no attribute 'findAll'

都有可能意味着，没有找到相应的目标而返回了None。