{1正在尝试从网站下载期刊(^ m)。我运行了一些东西来获取这个页面上的所有PDF文件。但是这些PDF中有链接链接到另一个PDF。在
我想从所有的PDF链接得到终端文章。在import os
import requests
from urllib.parse import urljoin
from bs4 import BeautifulSoup
url = "http://cis-ca.org/islamscience1.php"
#If there is no such folder, the script will create one automatically
folder_location = r'webscraping'
if not os.path.exists(folder_location):os.mkdir(folder_location)
response = requests.get(url)
soup= BeautifulSoup(response.text, "html.parser")
for link in soup.select("a[href$='.pdf']"):
#Name the pdf files using the last portion of each link which are unique in this case
filename = os.path.join(folder_location,link['href'].split('/')[-1])
with open(filename, 'wb') as f:
f.write(requests.get(urljoin(url,link['href'])).content)
我想把这些PDF里面的文章链接起来。
提前谢谢