yyq675886993的博客

BeautifulSoup的find（）和findAll（）可通过标签的不同属性轻松的过滤HTML页面，查找需要的标签组或单个标签#findAll(tag,attributes,recursive,text,limit,keywords) #find(tag,attributes,recursive,text,keywords) #爬取大众点评的一页信息 from urllib.request im

爬虫异常处理：from urllib.request import urlopen from urllib.error import HTTPError,URLError from bs4 import BeautifulSoup def getTitle(url): try: html=urlopen(url) except(HTTPError,URLEr

1.处理子标签和其他后代标签 孩子（child）和后代（descendant）from urllib.request import urlopen from bs4 import BeautifulSoup html=urlopen("http://www.pythonscraping.com/pages/page3.html") bsObj=BeautifulSoup(html)for chil

#爬取大众点评多页数据 from urllib.request import urlopen from bs4 import BeautifulSoup import pymongo client = pymongo.MongoClient('localhost',27017) dzdp = client['dzdp'] url_list = dzdp['url_list'] item_info =

爬取赶集网的页面链接#赶集网首页静态页面的链接爬取 from urllib.request import urlopen from bs4 import BeautifulSoup import rehtml=urlopen("http://ty.ganji.com/") bsObj=BeautifulSoup(html)for link in bsObj.find("div",{"class":"