百度网页数据采集

（一）获取百度网页网址

1. 获取网页地址https://www.baidu.com/
2. 打开开发者模式复制网页的cURL内容
3. 进入https://curlconverter.com/进行转换成

import requests
header={
'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.0.0 Safari/537.36'
}
repsonse = requests.get(https://www.baidu.com/,headers=header)

（二）解析网页

1. 打印状态码

   import requests
   header={
   'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.0.0 Safari/537.36'
   }
   proxi