requests爬虫get请求

最新推荐文章于 2023-05-20 15:20:57 发布

weixin_30609287

最新推荐文章于 2023-05-20 15:20:57 发布

阅读量95

点赞数

文章标签：爬虫

原文链接：http://www.cnblogs.com/andy9468/p/11492910.html

版权

1、简单get请求

url = 'https://www.baidu.com'
headers = {
    'accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8',
    'accept-encoding': 'gzip, deflate, br',
    'accept-language': 'zh-CN,zh;q=0.9',
    'upgrade-insecure-requests': '1',
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36',
    # 'cookie': 'xxx;yyy;zzz',
    # 'referer': 'https://xxx.yyy.zzz'
}

# 发起get请求
response = requests.get(url, headers=headers, verify=True)
# 获取html文本
html_data = response.content.decode()
print(html_data)
print(len(html_data))

转载于:https://www.cnblogs.com/andy9468/p/11492910.html