python爬虫爬取必应壁纸

最新推荐文章于 2024-05-23 10:56:21 发布

冯岳松

最新推荐文章于 2024-05-23 10:56:21 发布

阅读量403

点赞数 4

分类专栏： python 文章标签： python

本文链接：https://blog.csdn.net/fengyuesong/article/details/107434142

版权

python 专栏收录该内容

9 篇文章 1 订阅

订阅专栏

python爬虫爬取必应壁纸
运行getWallPaper.py，输入需要爬取的壁纸组数（一组12张）即可
需要安装的库：requests,BeautifulSoup4

import os
import requests
import bs4

COUNT = 1


def getWallPaper(n):
    global COUNT
    url = 'https://bing.ioliu.cn/?p=' + str(n)
    header = {'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) '
                            'Chrome/83.0.4103.116 Safari/537.36 Edg/83.0.478.64'}
    page = requests.get(url=url, headers=header)
    page.raise_for_status()
    soup = bs4.BeautifulSoup(page.text, "html.parser")
    lists = soup.select('.mark')

    image_lists = []
    for item in lists:
        image_lists.append(str(item)[str(item).index('/'):str(item).index('?')])

    download_urls = []
    for item in image_lists:
        download_urls.append('https://bing.ioliu.cn' + item + '?force=download')

    for download_url in download_urls:
        if os.path.exists('wallpapers/' + download_url[28:download_url.index('_')] + '.jpg'):
            print('壁纸' + str(COUNT) + '已存在')
            COUNT += 1
        if not os.path.exists('wallpapers/' + download_url[28:download_url.index('_')] + '.jpg'):
            image = requests.get(url=download_url, headers=header)
            image_file = open('wallpapers/' + download_url[28:download_url.index('_')] + '.jpg', 'wb')
            image_file.write(image.content)
            print('已下载' + str(COUNT) + '张壁纸')
            COUNT += 1


if not os.path.exists('wallpapers/'):
    os.makedirs('wallpapers/')

n = int(input('一组12张壁纸，您想下载几组：'))
for i in range(1, n + 1):
    getWallPaper(i)