java下载pdf文件空白_使用requests库和urlretrieve下载pdf文件

一、代码如下:

import requests   #导入请求库from urllib.request import urlretrieve     #从urllib.request导入下载函数urlretrieveimport re,time   #导入正则库和时间库from lxml import etree   #从lxml导入etree类def gethtml():   #定义函数gethtml用来下载pdf文件    url="http://www.gov.cn/zhengce/pdfFile/downloadFile.htm"   #设置请求网址    headers={        "User-Agent": "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36"    }                 #设置请求头headers    response=requests.get(url,headers=headers)    #通过headers伪装对网站url进行get请求,并将响应内容赋值给response变量    response.encoding=response.apparent_encoding   #根据网页内容解析出网页的编码格式并赋值给响应的编码变量response.encoding    html=response.text   #将网页的相应的文本内容赋值给html    html=etree.HTML(html)   #对html构造了一个XPath解析对象并对自动修正并赋值给html    result=html.xpath('//tbody/tr')   #使用xpath找到tr标签并赋值给result    urllist=[]   #定义接收网址的空列表urllist    for info in result:    #遍历result里的变量info        try:   #尝试操作            urllist.append("http://www.gov.cn"+info.xpath('./td[2]/a/@href')[-1])   #将解析到的td标签的href属性值的最后一个元素与"http://www.gov.cn"相加并添加到列表urllist中        except:   #当接收到错误时,            continue  #继续执行    # print(urllist)    for downurl in urllist:   #遍历urllist列表中的网址downurl        urlretrieve(downurl,"E://IT/PYthon/PYTHON试验/gov/"+downurl.split("/")[-1])   #下载网址downurl,并保存到本机的E://IT/PYthon/PYTHON试验/gov/文件夹下面,文件名用下载网址的最后切割的名称        print("E://IT/PYthon/PYTHON试验/gov/"+downurl.split("/")[-1]+"下载成功")   #打印下载成功        time.sleep(0.1)   #每执行一次下载休眠0.1秒gethtml()   #调用gethtml函数

二、代码运行结果如下:

E://IT/PYthon/PYTHON试验/gov/PDF_ALL.zip下载成功

E://IT/PYthon/PYTHON试验/gov/2020_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2019_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2018_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2017_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2016_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2015_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2014_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2013_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2012_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2011_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2010_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2009_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2008_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2007_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2006_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2005_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2004_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2003_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2002_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2001_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/2000_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1999_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1998_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1997_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1996_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1995_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1994muLu.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1994_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1993_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1992muLu.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1992_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1991_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1990_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1989_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1988_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1987_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1986_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1985_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1984_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1983_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1982_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1981_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1980_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1979_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1978_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1973_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1971_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1970_PDF.pdf下载成功

E://IT/PYthon/PYTHON试验/gov/1969_PDF.pdf下载成功

三、代码和代码运行结果如下图所示:

615c8236b8484c7fa502e67de507c2eb

最终保存到本机的数据如下图所示:

549b19831a7e4bb69a48935b7cca2441
7a11ddcc3167483582d075e9dbf72e2a
  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值