requests爬虫爬取页面数据

新建文件test.py，写入一下代码

import requests#通过pip install requests安装
from bs4 import BeautifulSoup#通过pip install bs4安装
import re#安装了python就有了re模块
import json#安装了python就有了json模块
response = requests.get('http://ncov.dxy.cn/ncovh5/view/pneumonia')
home_page = response.content.decode()#content是二进制数据，需要进行解码
soup = BeautifulSoup(home_page,'lxml')#通过pip install lxml安装
script = soup.find(id='getAreaStat')
text = re.findall(r'\[.+\]',script.string)[0]
with open('data.json','w',encoding='utf-8') as fp:#encoding和ensure_ascii解决中文乱码
    json.dump(json.loads(text),fp,ensure_ascii=False)#json.loads把json格式的字符串转为python类型；json.dump以json格式保存

在命令行中执行python test.py,就会在当前目录得到你要的json文件