爬虫学习Day13 2023/7/19

今天爬取肯德基官网地址数据，与爬取豆瓣电影内容大同小异，代码如下：

import urllib.request
import urllib.parse
def creat_request(page):
base_url = 'http://ww.kfc,com, cn/kfccda/ashx/'
headers = {
'User-Agent' : 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36 Edg/114.0.1823.82'
}
data = {'cname' :'运城',
'pid' :'pageIndex',
'agepageSize':'10'
}
data = urllib.parse.urlencode(data)
url = data + base_url
request = urllib.request.Request(url=url, headers=headers)
return request
def get_content(request):
urllib.request.urlopen(request)
content = response.read().decode('utf-8')
return(content)
def down_load(page,content)
with open('kfc' + str(page) + 'json','w',encoding='utf-8')as fp:
fp.write(content)

start_page = int(input('请输入起始页码'))
end_page = int(input('请输入结束页码'))
for page in range(start_page,end_page+1):
request = creat_request(page)
content = get_content(request)
down_load(page,content)
今天就芥末多。