python爬虫下载影视网站的电影

最新推荐文章于 2024-06-05 19:03:06 发布
最新推荐文章于 2024-06-05 19:03:06 发布
阅读量7.9k 收藏 47
点赞数 6
分类专栏： 笔记 文章标签： python
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/qq_45796487/article/details/109590508
版权

python爬虫下载影视网站的电影

  1. 我这边选取了vip网站
  2. F12打开调试抓包模式
  3. 搜索影片的名称, 观察看看给那个url地址发送了请求,
    在这里插入图片描述 我看到了 这个请求需要携带发送数据 而这个数据就是我们要的影片名字
    这样的就话就可以构建第一段代码
class Video():
    """获取电影信息"""
    def __init__(self):
        self.query = input("请输入你要下的电影或者电视:")
        # query = "闪电侠"

        self.form_data = {
            "wd": self.query
        }

        self.url = "http://m.6080w.com/index.php?m=vod-search"
        self.headers = {

            "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9",
            "Accept-Encoding": "gzip, deflate",
            "Accept-Language": "zh-CN,zh;q=0.9",
            "Cache-Control": "max-age=0",
            "Connection": "keep-alive",
            "Content-Length": "30",
            "Content-Type": "application/x-www-form-urlencoded",
            "Cookie": "__cfduid=d9734b9dde8ba7cb1e88c1ea50773d3081604822345; UM_distinctid=175a6dda4fc2f-0593ff933e9314-303464-15f900-175a6dda4fdaac; CFWztgVisitTotal_643_Cookie=8; cck_lasttime=1604903088259; cck_count=2; PHPSESSID=33ctoent9p7gmees4v57evahqr; Hm_lvt_1be9687a89f08192cf85d11531ef7b32=1604886953,1604887736,1604907659,1604908160; CNZZDATA1276411901=1025499974-1604819080-null%7C1604932558; mac_history=%7Bvideo%3A%5B%7B%22name%22%3A%22%u7784%u51C6%22%2C%22link%22%3A%22/Movie/234395.html%22%2C%22typename%22%3A%22%u79D1%u5E7B%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-07-24/159558122926.jpg%22%7D%2C%7B%22name%22%3A%22%u6CA1%u5927%u6CA1%u5C0F%22%2C%22link%22%3A%22/Movie/9415.html%22%2C%22typename%22%3A%22%u559C%u5267%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22tu.php%3Ftu%3Dr1.ykimg.com/05160000513555459792737957002CAE%22%7D%2C%7B%22name%22%3A%22%u884C%u5C38%u4E4B%u60E7%u7B2C%u516D%u5B63%22%2C%22link%22%3A%22/Movie/241403.html%22%2C%22typename%22%3A%22%u6B27%u7F8E%u5267%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-10-12/160243920319.jpg%22%7D%2C%7B%22name%22%3A%22%u6B66%u795E%u4E3B%u5BB0%22%2C%22link%22%3A%22/Movie/220270.html%22%2C%22typename%22%3A%22%u52A8%u6F2B%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-03-08/15836400263.jpg%22%7D%2C%7B%22name%22%3A%22%u7535%u51FB%u5C0F%u5B503%u4E4B%u56DB%u5723%u56E2%22%2C%22link%22%3A%22/Movie/199684.html%22%2C%22typename%22%3A%22%u52A8%u6F2B%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2019-08-03/156477877615.jpg%22%7D%2C%7B%22name%22%3A%22%u9B3C%u5439%u706F%u4E4B%u9F99%u5CAD%u8FF7%u7A9F%22%2C%22link%22%3A%22/Movie/222460.html%22%2C%22typename%22%3A%22%u5267%u60C5%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-04-03/158590081711.jpg%22%7D%2C%7B%22name%22%3A%22%u91CD%u88C5%u673A%u7532%22%2C%22link%22%3A%22/Movie/243395.html%22%2C%22typename%22%3A%22%u52A8%u4F5C%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-11-08/16048116123.jpg%22%7D%2C%7B%22name%22%3A%22%u751F%u751F%u4E16%u4E16%22%2C%22link%22%3A%22/Movie/228446.html%22%2C%22typename%22%3A%22%u6E2F%u53F0%u5267%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-06-11/159185161516.jpg%22%7D%2C%7B%22name%22%3A%22%u4E24%u5929%u4E00%u591C%u7B2C%u56DB%u5B63%22%2C%22link%22%3A%22/Movie/213564.html%22%2C%22typename%22%3A%22%u7EFC%u827A%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2019-12-10/157590726511.jpg%22%7D%2C%7B%22name%22%3A%22%u641C%u7D22%5B2020%5D%22%2C%22link%22%3A%22/Movie/241908.html%22%2C%22typename%22%3A%22%u65E5%u97E9%u5267%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-10-18/160299720137.jpg%22%7D%2C%7B%22name%22%3A%22%u9752%u7C2A%u9501%u4E09%u5343%22%2C%22link%22%3A%22/Movie/243447.html%22%2C%22typename%22%3A%22%u5267%u60C5%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-11-09/16048836021.jpg%22%7D%2C%7B%22name%22%3A%22%u6211%u5BB6%u7684%u718A%u5B69%u5B50%22%2C%22link%22%3A%22/Movie/91863.html%22%2C%22typename%22%3A%22%u7EFC%u827A%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2019-06-22/156119406926.jpg%22%7D%5D%7D; cf_clearance=56e9fbefec1664c5ebc36ffdb29e75cff9845d67-1604937518-0-1zc9693d2bz50e9279eza2074e5-150; Hm_lpvt_1be9687a89f08192cf85d11531ef7b32=1604937549",
            "Host": "m.6080w.com",
            "Origin": "http://m.6080w.com",
            "Referer": "http://m.6080w.com/",
            "Upgrade-Insecure-Requests": "1",
            "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.183 Safari/537.36"

                    }
response = requests.post(url=url, data=self.form_data ,headers=headers)
return response.content.decode()

思路: 获取所需视频的信息> 获取所需视频的视频页数 > 获取所需视频的视频地址

  1. 获取简介里面的ur地址 再手动添加http加域名
    在这里插入图片描述
    5.接下来利用xpath来提取url
    在这里插入图片描述
    5.接下来到了视频的主界面了, 视频的加载均为动态的视频地址 每一个地址都是一小段视频
    在这里插入图片描述
    分析 找到了结尾的文件名
    在这里插入图片描述
    发现是一个文件存着所有信息

下面就可以构建url进行所有片段视频的下载， 再用视频拼接软件进行片段视频代码的拼接。
在这里插入图片描述
下面直接上源码:
我定义了5个模块它们都是相互依赖
def_main.py

from 电影大全 import void
from 电影大全 import program_api

class Movie_House():
    def run(self):
        # 打印帮助文档
        api = program_api.help_api()
        api.help()

        #实现程序
        movie = void.Down_video()
        movie.Run()


def main():
    m = Movie_House()
    m.run()


if __name__ == '__main__':
    main()

down_video.py

import re
import requests
import os
from lxml import etree
import sys,time
from tqdm import tqdm

class Down():
    def __init__(self, video_name):
        self.video_name = video_name
        self.url = "//www.6080w.com/prestrain.htmlhttps://zuidajiexi.net/m3u8.html?url=https://douban.donghongzuida.com/20201108/12160_6b904f04/index.m3u8"
        # self.url = input("请输入视频网址:")
        print("具体格式:")
        print("//www.6080w.com/prestrain.htmlhttps://zuidajiexi.net/m3u8.html?url=https://douban.donghongzuida.com/20201108/12160_6b904f04/index.m3u8")
        self.url2 = self.url.split("="[-1])[-1].split("index")[0] + "1000k/hls/index.m3u8"
        self.url21 = self.url.split("="[-1])[-1].split("index")[0] + "1000k/hls/"

        # print(url2)
        # print(url21)

        self.headers3 = {

            "user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.183 Safari/537.36"
        }

    def get_respones(self, url, headers):
        ret = requests.get(url=url, headers=headers)
        return ret.content.decode()


    def D_file(self):
        path = str(self.video_name)
        if not os.path.exists(path):
            os.mkdir(path)
            print("文件创建成功")


    def run(self):
        response = self.get_respones(self.url2, self.headers3)
        # print(response)
        res = re.findall(r'.*?ts', response)
        # print(res)
        num = 0
        print("视频开始下载请稍后......")
        start_time = time.time()
        for rets in tqdm(res, ncols=50):
            time.sleep(0.05)
            t = str(rets).strip()
            urls = self.url21 + t
            # print(urls, end=" ")
            response = requests.get(url=urls, headers=self.headers3)
            data = response.content
            # print(data)
            self.D_file()
            file_name = "./" + self.video_name + "//第{}段视频.mp4".format(num)
            with open(file_name, 'wb') as f:
                f.write(data)
                print("第{}段视频保存成功".format(num))
                num += 1
        end_time = time.time()
        print("恭喜你视频下载成功! 你花费了{}时间".format((end_time-start_time)))

program_api.py

class help_api():
    def help(self):
        print(
            "1、运行def_main.py文件将程序运行\n"
            "2、按照提示录入数据\n"
            "3、直到提示出现: 请点击页面地址复制url视频接口\n"
            "4、点击出现的链接 (最好使用chrome(谷歌浏览器))按F12 进入网页调试工具\n"
            "5、点击Elements页面 按住Ctrl+F 进入元素查找 然后将控制台的xpath内容填写进去\n"
            "6、复制里面的url链接 填写到url视频接口中\n"
            "7、下载视频合成工具(推荐使用格式工厂)"
            "8、将创建保存的文件夹下的所有片段视频进行合并"
        )

video_api.py

import requests
from lxml import etree

class Video():
    """获取电影信息"""
    def __init__(self):
        self.query = input("请输入你要下的电影或者电视:")
        # query = "闪电侠"

        self.form_data = {
            "wd": self.query
        }

        self.url = "http://m.6080w.com/index.php?m=vod-search"
        self.headers = {

            "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9",
            "Accept-Encoding": "gzip, deflate",
            "Accept-Language": "zh-CN,zh;q=0.9",
            "Cache-Control": "max-age=0",
            "Connection": "keep-alive",
            "Content-Length": "30",
            "Content-Type": "application/x-www-form-urlencoded",
            "Cookie": "__cfduid=d9734b9dde8ba7cb1e88c1ea50773d3081604822345; UM_distinctid=175a6dda4fc2f-0593ff933e9314-303464-15f900-175a6dda4fdaac; CFWztgVisitTotal_643_Cookie=8; cck_lasttime=1604903088259; cck_count=2; PHPSESSID=33ctoent9p7gmees4v57evahqr; Hm_lvt_1be9687a89f08192cf85d11531ef7b32=1604886953,1604887736,1604907659,1604908160; CNZZDATA1276411901=1025499974-1604819080-null%7C1604932558; mac_history=%7Bvideo%3A%5B%7B%22name%22%3A%22%u7784%u51C6%22%2C%22link%22%3A%22/Movie/234395.html%22%2C%22typename%22%3A%22%u79D1%u5E7B%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-07-24/159558122926.jpg%22%7D%2C%7B%22name%22%3A%22%u6CA1%u5927%u6CA1%u5C0F%22%2C%22link%22%3A%22/Movie/9415.html%22%2C%22typename%22%3A%22%u559C%u5267%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22tu.php%3Ftu%3Dr1.ykimg.com/05160000513555459792737957002CAE%22%7D%2C%7B%22name%22%3A%22%u884C%u5C38%u4E4B%u60E7%u7B2C%u516D%u5B63%22%2C%22link%22%3A%22/Movie/241403.html%22%2C%22typename%22%3A%22%u6B27%u7F8E%u5267%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-10-12/160243920319.jpg%22%7D%2C%7B%22name%22%3A%22%u6B66%u795E%u4E3B%u5BB0%22%2C%22link%22%3A%22/Movie/220270.html%22%2C%22typename%22%3A%22%u52A8%u6F2B%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-03-08/15836400263.jpg%22%7D%2C%7B%22name%22%3A%22%u7535%u51FB%u5C0F%u5B503%u4E4B%u56DB%u5723%u56E2%22%2C%22link%22%3A%22/Movie/199684.html%22%2C%22typename%22%3A%22%u52A8%u6F2B%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2019-08-03/156477877615.jpg%22%7D%2C%7B%22name%22%3A%22%u9B3C%u5439%u706F%u4E4B%u9F99%u5CAD%u8FF7%u7A9F%22%2C%22link%22%3A%22/Movie/222460.html%22%2C%22typename%22%3A%22%u5267%u60C5%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-04-03/158590081711.jpg%22%7D%2C%7B%22name%22%3A%22%u91CD%u88C5%u673A%u7532%22%2C%22link%22%3A%22/Movie/243395.html%22%2C%22typename%22%3A%22%u52A8%u4F5C%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-11-08/16048116123.jpg%22%7D%2C%7B%22name%22%3A%22%u751F%u751F%u4E16%u4E16%22%2C%22link%22%3A%22/Movie/228446.html%22%2C%22typename%22%3A%22%u6E2F%u53F0%u5267%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-06-11/159185161516.jpg%22%7D%2C%7B%22name%22%3A%22%u4E24%u5929%u4E00%u591C%u7B2C%u56DB%u5B63%22%2C%22link%22%3A%22/Movie/213564.html%22%2C%22typename%22%3A%22%u7EFC%u827A%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2019-12-10/157590726511.jpg%22%7D%2C%7B%22name%22%3A%22%u641C%u7D22%5B2020%5D%22%2C%22link%22%3A%22/Movie/241908.html%22%2C%22typename%22%3A%22%u65E5%u97E9%u5267%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-10-18/160299720137.jpg%22%7D%2C%7B%22name%22%3A%22%u9752%u7C2A%u9501%u4E09%u5343%22%2C%22link%22%3A%22/Movie/243447.html%22%2C%22typename%22%3A%22%u5267%u60C5%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-11-09/16048836021.jpg%22%7D%2C%7B%22name%22%3A%22%u6211%u5BB6%u7684%u718A%u5B69%u5B50%22%2C%22link%22%3A%22/Movie/91863.html%22%2C%22typename%22%3A%22%u7EFC%u827A%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2019-06-22/156119406926.jpg%22%7D%5D%7D; cf_clearance=56e9fbefec1664c5ebc36ffdb29e75cff9845d67-1604937518-0-1zc9693d2bz50e9279eza2074e5-150; Hm_lpvt_1be9687a89f08192cf85d11531ef7b32=1604937549",
            "Host": "m.6080w.com",
            "Origin": "http://m.6080w.com",
            "Referer": "http://m.6080w.com/",
            "Upgrade-Insecure-Requests": "1",
            "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.183 Safari/537.36"

                    }

        self.headers2 = {

            "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9",
            "Accept-Encoding": "gzip, deflate",
            "Accept-Language": "zh-CN,zh;q=0.9",
            "Cache-Control": "max-age=0",
            "Connection": "keep-alive",
            "Cookie": "__cfduid=d9734b9dde8ba7cb1e88c1ea50773d3081604822345; UM_distinctid=175a6dda4fc2f-0593ff933e9314-303464-15f900-175a6dda4fdaac; CFWztgVisitTotal_643_Cookie=8; cck_lasttime=1604903088259; cck_count=2; PHPSESSID=33ctoent9p7gmees4v57evahqr; Hm_lvt_1be9687a89f08192cf85d11531ef7b32=1604886953,1604887736,1604907659,1604908160; CNZZDATA1276411901=1025499974-1604819080-null%7C1604932558; mac_history=%7Bvideo%3A%5B%7B%22name%22%3A%22%u7784%u51C6%22%2C%22link%22%3A%22/Movie/234395.html%22%2C%22typename%22%3A%22%u79D1%u5E7B%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-07-24/159558122926.jpg%22%7D%2C%7B%22name%22%3A%22%u6CA1%u5927%u6CA1%u5C0F%22%2C%22link%22%3A%22/Movie/9415.html%22%2C%22typename%22%3A%22%u559C%u5267%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22tu.php%3Ftu%3Dr1.ykimg.com/05160000513555459792737957002CAE%22%7D%2C%7B%22name%22%3A%22%u884C%u5C38%u4E4B%u60E7%u7B2C%u516D%u5B63%22%2C%22link%22%3A%22/Movie/241403.html%22%2C%22typename%22%3A%22%u6B27%u7F8E%u5267%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-10-12/160243920319.jpg%22%7D%2C%7B%22name%22%3A%22%u6B66%u795E%u4E3B%u5BB0%22%2C%22link%22%3A%22/Movie/220270.html%22%2C%22typename%22%3A%22%u52A8%u6F2B%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-03-08/15836400263.jpg%22%7D%2C%7B%22name%22%3A%22%u7535%u51FB%u5C0F%u5B503%u4E4B%u56DB%u5723%u56E2%22%2C%22link%22%3A%22/Movie/199684.html%22%2C%22typename%22%3A%22%u52A8%u6F2B%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2019-08-03/156477877615.jpg%22%7D%2C%7B%22name%22%3A%22%u9B3C%u5439%u706F%u4E4B%u9F99%u5CAD%u8FF7%u7A9F%22%2C%22link%22%3A%22/Movie/222460.html%22%2C%22typename%22%3A%22%u5267%u60C5%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-04-03/158590081711.jpg%22%7D%2C%7B%22name%22%3A%22%u91CD%u88C5%u673A%u7532%22%2C%22link%22%3A%22/Movie/243395.html%22%2C%22typename%22%3A%22%u52A8%u4F5C%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-11-08/16048116123.jpg%22%7D%2C%7B%22name%22%3A%22%u751F%u751F%u4E16%u4E16%22%2C%22link%22%3A%22/Movie/228446.html%22%2C%22typename%22%3A%22%u6E2F%u53F0%u5267%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-06-11/159185161516.jpg%22%7D%2C%7B%22name%22%3A%22%u4E24%u5929%u4E00%u591C%u7B2C%u56DB%u5B63%22%2C%22link%22%3A%22/Movie/213564.html%22%2C%22typename%22%3A%22%u7EFC%u827A%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2019-12-10/157590726511.jpg%22%7D%2C%7B%22name%22%3A%22%u641C%u7D22%5B2020%5D%22%2C%22link%22%3A%22/Movie/241908.html%22%2C%22typename%22%3A%22%u65E5%u97E9%u5267%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-10-18/160299720137.jpg%22%7D%2C%7B%22name%22%3A%22%u9752%u7C2A%u9501%u4E09%u5343%22%2C%22link%22%3A%22/Movie/243447.html%22%2C%22typename%22%3A%22%u5267%u60C5%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-11-09/16048836021.jpg%22%7D%2C%7B%22name%22%3A%22%u6211%u5BB6%u7684%u718A%u5B69%u5B50%22%2C%22link%22%3A%22/Movie/91863.html%22%2C%22typename%22%3A%22%u7EFC%u827A%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2019-06-22/156119406926.jpg%22%7D%5D%7D; cf_clearance=56e9fbefec1664c5ebc36ffdb29e75cff9845d67-1604937518-0-1zc9693d2bz50e9279eza2074e5-150; Hm_lpvt_1be9687a89f08192cf85d11531ef7b32=1604937754",
            "Host": "m.6080w.com",
            "Referer": "http://m.6080w.com/index.php?m=vod-search",
            "Upgrade-Insecure-Requests": "1",
            "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.183 Safari/537.36"
        }



        self.headers3 = {

            "Cookie": "__cfduid=d9734b9dde8ba7cb1e88c1ea50773d3081604822345; UM_distinctid=175a6dda4fc2f-0593ff933e9314-303464-15f900-175a6dda4fdaac; CFWztgFirstShowTime_643_Cookie=2020-11-8%2023%3A9%3A48; CFWztgVisitTotal_643_Cookie=7; cck_count=1; cck_lasttime=1604858787429; mac_history=%7Bvideo%3A%5B%7B%22name%22%3A%22%u95EA%u7535%u4FA0%u7B2C%u4E94%u5B63%22%2C%22link%22%3A%22/Movie/139107.html%22%2C%22typename%22%3A%22%u6B27%u7F8E%u5267%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2018-11-28/154340757520.jpg%22%7D%2C%7B%22name%22%3A%22%u91CD%u88C5%u673A%u7532%22%2C%22link%22%3A%22/Movie/243410.html%22%2C%22typename%22%3A%22%u79D1%u5E7B%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-11-08/160482961924.jpg%22%7D%2C%7B%22name%22%3A%22%u6F2B%u5A01%u82F1%u96C4%uFF1A%u795E%u5947%u641E%u7B11%22%2C%22link%22%3A%22/Movie/233192.html%22%2C%22typename%22%3A%22%u52A8%u6F2B%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-07-13/159462720510.jpg%22%7D%2C%7B%22name%22%3A%22%u9B3C%u5439%u706F%u4E4B%u9F99%u5CAD%u8FF7%u7A9F%22%2C%22link%22%3A%22/Movie/222460.html%22%2C%22typename%22%3A%22%u5267%u60C5%u7247%22%2C%22typelink%22%3A%22/vodlist/-1.html%22%2C%22pic%22%3A%22upload/vod/2020-04-03/158590081711.jpg%22%7D%5D%7D; CNZZDATA1276411901=1025499974-1604819080-null%7C1604862301; cf_clearance=2326376d4521dcf683859b555eca275817ed2fef-1604863264-0-1zc9693d2bz50e9279eza2074e5-150; Hm_lvt_1be9687a89f08192cf85d11531ef7b32=1604863389,1604863667,1604863812,1604863960; PHPSESSID=8qrr0ovqf2qt86gj70glcphvm1; Hm_lpvt_1be9687a89f08192cf85d11531ef7b32=1604864668",
            "user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.183 Safari/537.36"



        }


    def Get_Response(self, url, headers, code=True):
        """发送请求获取响应"""
        if code:
            response = requests.post(url=url, data=self.form_data ,headers=headers)
            return response.content.decode()
        else:
            response = requests.get(url=url, data=self.form_data, headers=headers)
            return response.content.decode()

    def Wash_Html_Data(self, srt_html):
        """清洗数据"""
        html = etree.HTML(srt_html)
        # 对页面进行分组
        # div = html.xpath("//div[@class='container']/div[@class='row']/div/div/div")
        div = html.xpath("//div[@class='container']/div[@class='row']/div/div/div")

        self.video_list = []

        self.url_list = []

        self.video_url = []
        for div_tmp in div:
            div_dict = {}
            # 提取电影名称
            div_dict['video_name'] = div_tmp.xpath("./div/dl/dd/div[@class='head']/h3/text()")
            div_dict['video_name'] = div_dict['video_name'][0] if len(div_dict['video_name']) > 0 else None

            # 提取封面里的详细的地址
            video_url = div_tmp.xpath("./div/dl/dt/a/@href")
            video_url = "http://m.6080w.com/" + video_url[0] if len(video_url) > 0 else None
            self.video_url.append(video_url)

            div_dict['video_url'] = div_tmp.xpath("./div/dl/dt/a/@href")
            div_dict['video_url'] = "http://m.6080w.com/" + div_dict['video_url'][0] if len(div_dict['video_url']) > 0 else None

            # 提取电影封面地址
            div_dict['video_img_url'] = div_tmp.xpath("./div/dl/dt/a/@style")
            div_dict['video_img_url'] = div_dict['video_img_url'][0].split("(")[-1].split(")")[0] if len(div_dict['video_img_url']) > 0 else None

            # 提取电影评分
            div_dict['video_score'] = div_tmp.xpath("./div/dl/dd/div/span/text()")
            div_dict['video_score'] = div_dict['video_score'][0] if len(div_dict['video_score']) > 0 else None

            # 提取电影主演
            div_dict['video_header'] = div_tmp.xpath("./div/dl/dd/ul/li/text()")
            div_dict['video_header'] = div_dict['video_header'][0] if len(div_dict['video_header']) > 0 else None
            # 提取电影导演
            # 提取电影地区
            # 提取电影类型
            # 提取电影语言
            # 提取电影年份

            self.video_list.append(div_dict)

        # 提取下一页的 url地址
        # http://m.6080w.com/
        next = html.xpath("/html/body/div[1]/div/div[1]/div/div[22]/a[2]/@href")
        nex_url = "http://m.6080w.com/" + next[0] if len(next) > 0 else None
        self.url_list.append(nex_url)
        # print(url_list)

        return self.video_list, self.url_list, self.video_url


    def Print_Data(self, video_list):
        """打印可视视频数据"""
        num = 1
        for data in video_list:
            print()
            print("第{}部:".format(num))
            print("电影名称:{}\n详细地址:{}\n电影封面地址:{}\n电影评分:{}\n电影主演:{}".format(data['video_name'], data['video_url'],data['video_img_url'], data['video_score'], data['video_header']))
            print("#"*50)
            print()
            num += 1

void.py

from 电影大全 import video_api
from lxml import etree
import re
from  电影大全 import down_video

class Down_video(video_api.Video):
    def url_video(self, url):
        for tmp in url:
            self.video_in_urls.append(tmp)

    def wash_html(self, str_html):
        """清洗数据"""
        html = etree.HTML(str_html)
        html_div = html.xpath("//div[@id='playlist1']/ul/li") # 分组
        video_name_list = []
        video_name = {}
        dict_list = []
        for div in html_div:
            div_dict = {}

            # 获取页码数
            div_dict['video_code_number'] = div.xpath("./a/text()")
            div_dict['video_code_number'] = div_dict['video_code_number'][0] if len(div_dict['video_code_number']) > 0 else None

            # 获取对应的url地址
            div_dict['video_url'] = div.xpath("./a/@href")
            div_dict['video_url'] = "http://m.6080w.com/" + div_dict['video_url'][0] if len(div_dict) > 0 else None
            dict_list.append(div_dict)
        # 获取片名
        video_name['video_name'] = html.xpath("//div[@class='hy-video-details clearfix']/div/dl/dd/div/h3/text()")
        video_name['video_name'] = video_name['video_name'][0] if len(video_name['video_name']) > 0 else None

        # 获取片名信息
        video_name['video_data'] = html.xpath("//div[@class='hy-video-details clearfix']/div/dl/dd/ul/li/text()")
        video_name['video_data'] = video_name['video_data'][0] if len(video_name['video_data']) > 0 else None
        video_name_list.append(video_name)
        return  dict_list, video_name_list


    def inedx_html(self, str_html):
        print(str_html)
        html = etree.HTML(str_html)
        # 获取ts
        play_url = html.xpath("//div[@class='container']/div/div/div/div/div/table/tbody/tr/td/iframe/@src")

        print(play_url)

        # https://youku.cdn3-okzy.com/20191209/4820_5020c357/1000k/hls/index.m3u8
        play_url = play_url.split("="[-1])[-1].split("index")[0] + "1000k/hls/index.m3u8"
        video_url = play_url.split("="[-1])[-1].split("index")[0] + "1000k/hls/"
        response = self.Get_Response(url=play_url, headers=self.headers3, code=False)
        res = re.findall(r'c.*?ts', response)
        for ts in res:
            url = video_url+ts
            print(url)


    def print_wash_data(self, wash_dict_list, wash_video_name_list):
        """打印清洗数据"""
        url = []
        for data in wash_dict_list:
            print()
            print("片名:{}\n片名信息:{}\n集数:{}\n链接:{}".format(wash_video_name_list[0]['video_name'],wash_video_name_list[0]['video_data'] ,data['video_code_number'], data['video_url']))
            # print("url=====", data['video_url'])
            url.append(data['video_url'])
            print("#" * 50)
            print()

        page = int(input("请输入你要下载的视频的集数:"))
        url.reverse()
        urls = url[page-1]

        print("请点击页面地址复制url视频接口")
        print("本集/本电影的url地址如下\n:{}".format(urls))
        print("xpath://div[@class='container']/div/div/div/div/div/table/tbody/tr/td/iframe/@src")

        down = down_video.Down(self.query)
        down.run()


    def content(self, url):
        """获取url发送请求获取响应"""
        str_html = self.Get_Response(url=url, headers=self.headers2)
        wash_dict_list, wash_video_name_list = self.wash_html(str_html)
        self.print_wash_data(wash_dict_list=wash_dict_list, wash_video_name_list=wash_video_name_list)

    def Run(self):
        url = self.url
        print("正在爬取视频数据, 请稍候...")
        self.video_in_urls = []
        while url != None:
            # get response
            str_html = self.Get_Response(url=url, headers=self.headers)
            # print(str_html)
            video_lists, next_video_url, video_urls = self.Wash_Html_Data(str_html)
            # print(next_video_url)
            self.url_video(url=video_urls)
            # 打印视频数据
            self.Print_Data(video_list=video_lists)
            num = 0
            url = next_video_url[num]
            num += 1
        mv = int(input("请选择你要下载的影片:"))
        url = self.video_in_urls[mv-1]
        self.content(url=url)

提取成功:
在这里插入图片描述
合并成功:在这里插入图片描述

播放成功:
在这里插入图片描述

欣辰啊
关注
  • 6
    点赞
  • 踩
  • 47
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
python爬虫实现下载电影天堂电影
justforfun
09-26 1万+
这段时间一直在学习Python爬虫，为了加强学习过程，也为了以后的学习留下点痕迹，特此记录下整篇爬虫的过程。以电影天堂为例，提取出当前界面的最新电影。 # -*- coding:utf-8 -*- import urllib2 import os import re url = 'http://www.dy2018.com/html/gndy/dyzz/index.html' #这是电影天堂
python下载电影_python下载电影
weixin_39759182的博客
11-20 1170
广告关闭腾讯云11.11云上盛惠 ，精选热门产品助力上云，云服务器首年88元起，买的越多返的越多，最高返5000元！#写入本地 with open(re:personalvscode1.txt,a,encoding=utf-8) as ff:# 打开本地文件前面加上r或者用双反斜杠，a是追加的意思，编码格式为utf-8 ff.write(ftp+n)#类实例化 tm = get_address()...
Python爬取最爱的电影并下载到本地
weixin_51211600的博客
11-15 4157
小说、图片、小视频都弄了，今天就下载电影或者电视剧吧，目标网站：https://www.okzyw.com/ 首先进入搜索页面：https://www.okzyw.com/index.php?m=vod-search 搜索自己喜爱的剧（比如我就喜欢西部世界^ _ ^） 进入Network查看发现是POST请求： 我把数据也截下来了，直接上代码就行： import requests import parsel,os from ffmpy3 import FFmpeg from concurrent.fut
Python爬取视频(其实是一篇福利)过程解析
09-18
主要介绍了Python爬取视频(其实是一篇福利)过程解析,文中通过示例代码介绍的非常详细，对大家的学习或者工作具有一定的参考学习价值,需要的朋友可以参考下
记住看小电影前一定要检查网址是不是HTTPS的，不然…
最新发布
Python小二
06-05 356
1. HTTP 协议在谈论 HTTPS 协议之前，先来回顾一下 HTTP 协议的概念。1.1 HTTP 协议介绍HTTP 协议是一种基于文本的传输协议，它位于 OSI 网络模型中的应用层。HTTP 协议是通过客户端和服务器的请求应答来进行通讯，目前协议由之前的RFC 2616拆分成立六个单独的协议说明（RFC 7230、RFC 7231、RFC 7232、RFC 7233、RFC 7234、R...
这5款电影资源网站，让人第一眼就心动，第二眼就流连忘返！
视频格式转换器
12-10 6万+
工作烦心了一天，回到家忙完事情泡一杯热腾腾的咖啡，拿起手机或平板，打开电影网站，惬意的躺在沙发上享受自己心仪的电影带给你的快乐时光吧！ 今天小编为大家推荐几款电影资源网站，喜欢的小伙伴千万不要错过！ 1. 低端影视 http://ddrk.me/ 画质效果非常棒的一个网站！全程无广告，纯高清！支持电脑和手机设备，各种华语、日韩，欧美大片任你选! 2. KKTV https://...
我在b站上推荐一个看小电影的网站，结果被骂了
热门推荐
庆哥Java的CSDN技术博客
01-30 36万+
我在b站上推荐一个看小电影的网站，结果被骂了 这是怎么回事？真的很魔幻…… 我记得在某个时间段，有个话题很火爆，大致意思是说什么“这个时代的没落，是从好人变坏开始……” 好人为什么要变坏？ 你听说过劣币驱逐良币吗？上次发了一篇文章《公众号，已死？》，大家反响挺大的，都说太TM真实了，后台留言很多，有一些其实是没有放出来的，我这里简单说下。 比如有不少评论说出这种心声的，就是公众号号主太没底线了，什么垃圾发什么，吃香难看，咋咋咋的…… 说实话，我作为一个公众号号主的同时，也是一名公众号读者，我是会经常看公众号
学习flask技术并应用在跨模态视频检索系统
Sunnyztg的博客
07-12 1099
本文介绍了如何使用Flask技术在前端部署代码，实现一个跨模态视频检索系统。该系统的功能是：用户可以输入一段文本描述或者一张图片作为查询条件，系统会从一个视频库中检索出与之最相关的Top10视频片段，并在前端显示出来。用户可以点击视频片段的封面图或者时间戳来跳转到相应的位置播放。
python豆瓣电影爬虫
04-15
**Python 豆瓣电影爬虫** Python 是一种流行的编程语言，因其简洁的语法和强大的功能在数据分析、网络爬虫领域被广泛使用。本项目旨在利用Python构建一个爬虫，爬取豆瓣电影Top250的电影信息，包括电影名称、评分、...
Python爬虫实例项目-电影网站爬虫源码
07-05
在这个Python爬虫实例项目中，我们主要探讨如何利用Python3的Scrapy框架和Pymysql库来抓取并存储电影网站的数据。Scrapy是一个强大的、用于网络爬虫开发的Python框架，而Pymysql则是Python连接MySQL数据库的库，两者...
python爬虫开发代码-电影网站信息爬取案例
05-31
Python爬虫是编程领域中一个重要的技术分支，主要用于自动化地从互联网上提取大量数据。在这个“电影网站信息爬取案例”中，我们将深入探讨如何利用Python进行网络爬虫的开发，包括多线程爬取、单个电影信息的获取...
豆瓣电影python爬虫程序
11-20
这是一个简单的Python爬虫程序，旨在从豆瓣电影网站中提取电影信息。通过使用网络爬虫技术，该程序可以自动从豆瓣电影网页中抓取电影的名称、评分、演员、导演等信息，然后将这些数据存储或进一步处理，例如制作数据...
python爬虫爬取豆瓣电影评论
11-15
这个 Python 程序演示了如何使用网络爬虫技术获取豆瓣电影的评论。通过这个程序，你可以收集用户对特定电影的观点和评价。 选择电影： 输入你感兴趣的电影的豆瓣 ID。 发起请求： 使用 requests 库发起 HTTP 请求，...
不要随便点这个网站，你偷偷下载的小电影，他们全都知道！
weixin_33704234的博客
01-02 19万+
英国的独立报今日报道了一条消息，有这么一个网站，名字叫做“我知道你下载了什么”，刚听到的时候还不以为意，但是点击进去才发现，这网站并没有说谎，它真知道你都下载了什么，包括电影。 网站功能A 点开网站，就可以看到所有的下载记录 下载记录可以看到只要点开网站就可以看到所有的下载记录，当然我并没有下载小电影！很正经！ 网站功能B输入任何IP地址，就能查询到该地址的下载记录。 网站功能C你可以向你的朋友...
记住！看小电影前一定要检查一下域名是不是 HTTPS 的，不然....
Java后端技术
02-28 2095
往期热门文章：1、《往期精选优秀博文都在这里了！》 2、在 IDE 中玩转 GitHub 3、死磕18个Java8日期处理，工作必用！ 4、Netflix创始人：我不要求996，一样市值1...
python爬虫——电影天堂电影
2201_75769266的博客
08-03 27万+
【代码】python爬取——电影天堂电影。
Python爬取最爱的电影并下载到本地（附源码）
公众号：Python研究者
11-17 4531
小说、图片、小视频都弄了，今天就下载电影或者电视剧吧，目标网站：https://www.okzyw.com/首先进入搜索页面：https://www.okzyw.com/index.ph...
Python爬虫实战(八)：爬取电影天堂的电影下载链接
Python3 爬虫实战 1:应对特殊字体,爬取猫眼电影实时排行榜
10-29 1万+
#coding=utf-8 import re import requests import xlsxwriter from bs4 import BeautifulSoup def getHtml(url): headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:56.0) Gecko/20100
Python爬虫实践：抓取豆瓣电影TOP250数据
"该文档是南京航空航天大学计算机科学与技术学院信息安全专业的一份关于网络爬虫的实验报告，实验目标是抓取并分析豆瓣电影TOP250的详细数据。实验旨在让学生理解计算机网络协议，掌握Python编程以及HTML、CSS、...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值