python爬表格数据_python爬虫,爬取表格数据

python爬虫,爬取表格数据

python爬虫,爬取表格数据

python爬虫，爬取全国空气质量指数

编程环境：Jupyter Notebook

所要爬取的网页数据内容如下图

python爬虫代码及含义详细说明

#全国城市

import time

import requests

from bs4 import BeautifulSoup

headers = {

'User-Agent':'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36'

}#爬虫[Requests设置请求头Headers],伪造浏览器

# 核心爬取代码

url= 'http://www.tianqihoubao.com/aqi/aqi_rank.html'

params = {"show_ram":1}

response = requests.get(url,params=params, headers=headers)#访问url

listData=[]#定义数组

soup = BeautifulSoup(response.text, 'html.parser')#获取网页源代码

tr = soup.find('table',class_='b').find_all('tr')#.fi