爬虫之requests

requests是以urllib为底层开发的模块，相比于request，requests更简洁。

requests有三种请求方式：request，get，post；最常用的是post和get。

import requests

url = "http://www.baidu.com/s?"

kw = input("请输入关键字")
data = {"kw":kw}

headers = {
        "User-Agent": "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36"
}

1.get

rsp = requests.get(url,params=data,headers=headers)

2.post

rsp = requests.post(url,data=data,headers=headers)