【python爬虫】 从url下载文件

下载文件

import urllib.request
url = "https://s.shouji.qihucdn.com/210531/2a70c292be80b57dd71c928c11efe8d8/com.chengsong.waimai_30191.apk?en=curpage%3Dopenbox_wap_detail%26exp%3D1679649623%26from%3Dopenbox_mintf_getAppInfoByIds%26m2%3D%26ts%3D1679044823%26tok%3D6a7ba9432c3b24d81edfa330113015df%26v%3D%26f%3Dz.apk"
urllib.request.urlretrieve(url, "test.apk")

通过代理下载文件

import urllib.request

url = "https://www.google.com.hk/images/branding/googlelogo/2x/googlelogo_color_272x92dp.png"
myProxy = urllib.request.ProxyHandler({'http': '127.0.0.1:10802'})
openProxy = urllib.request.build_opener(myProxy)
urllib.request.urlretrieve(url,"test.png")

通过代理从重定向URL下载文件

例如URL https://d.apkpure.com/b/XAPK/com.canva.editor?version=latest最终会重定向到https://d-03.winudf.com/b/XAPK/Y29tLmNhbnZhLmVkaXRvcl80ODU1NV83MWM2YzEyNQ?_fn=Q2FudmE6IERlc2lnbiwgUGhvdG8gJiBWaWRlb18yLjIwOC4xX0Fwa3B1cmUueGFwaw&_p=Y29tLmNhbnZhLmVkaXRvcg%3D%3D&is_hot=false&k=04057a14ed5b944f0fced68741262c386420163c

# gpt-2
import urllib.request

# 设置代理服务器，如果不需要代理可以留空
proxy_handler = urllib.request.ProxyHandler({'http': '127.0.0.1:10802','https': '127.0.0.1:10802'})

opener = urllib.request.build_opener(proxy_handler)

# 添加头部信息
opener.addheaders = [('User-Agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36')]

# 安装opener
urllib.request.install_opener(opener)

url = "https://d.apkpure.com/b/XAPK/com.canva.editor?version=latest"

# 下载文件
urllib.request.urlretrieve(url, "com.canva.editor.xapk")

---

参考：
https://cloud.tencent.com/developer/article/1607001
https://chat.openai.com/chat