python简单爬虫课题_VS2019python爬虫入门

VS2019新建python项目

在vs2019中添加python编译环境

创建python控制台应用程序项目

配置python环境

安装requests第三方库

管理程序包，执行安装requests包命令pip install requests

导入第三方包

import requests

简单爬虫编写

import requests

if __name__ == "__main__":

kw = input(‘输入搜索关键词：‘)

url = ‘https://search.bilibili.com/all/‘

headers = {

‘user_agent‘:‘Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.146 Safari/537.36‘

}

data = {

‘keyword‘:kw

}

response = requests.get(url=url,params=data,headers=headers)

page_text = response.text

FileName = kw+‘.html‘

with open(FileName,‘w‘,encoding=‘utf-8‘) as fp:

fp.write(page_text)

print(FileName,‘成功!!‘)

测试

输入搜索关键词：爬虫

爬虫.html 成功!!

Press any key to continue . . .