1.百度关键词提交
替换keyword,
import requests
keyword="python"
try:
kv={'wd':keyword}
r=requests.get("http://www.baidu.com/s",params=kv)
print(r.request.url)
r.raise_for_status()
#r.encoding=r.apparent_encoding
print(len(r.text))
except:
print("爬取失败")
结果:
C:\Users\Administrator\AppData\Local\Programs\Python\Python37\python.exe C:/Users/Administrator/PycharmProjects/PaChong/Study/__init__.py
https://wappass.baidu.com/static/captcha/tuxing.html?&ak=c27bbc89afca0463650ac9bde68ebe06&backurl=https%3A%2F%2Fwww.baidu.com%2Fs%3Fwd%3Dpython&logid=10081099908402028772&signature=f4ef10841bbe4bce4b553304f6c60ba3×tamp=1588489031
1519
Process finished with exit code 0
上面的网页百度需要验证
2.360搜索
import requests
keyword="python"
try:
kv={'q':keyword}
r=requests.get("http://www.so.com/s",params=kv)
print(r.request.url)
r.raise_for_status()
#r.encoding=r.apparent_encoding
print(len(r.text))
except:
print("爬取失败")
结果:
C:\Users\Administrator\AppData\Local\Programs\Python\Python37\python.exe C:/Users/Administrator/PycharmProjects/PaChong/Study/__init__.py
https://www.so.com/s?q=python
277220
Process finished with exit code 0
360可以直接搜索