超简单爬虫获取猫眼电影热映榜

最新推荐文章于 2024-07-01 14:22:28 发布

cmd_ming

最新推荐文章于 2024-07-01 14:22:28 发布

阅读量444

点赞数 1

分类专栏：爬虫文章标签： python

本文链接：https://blog.csdn.net/qq_39280443/article/details/106407805

版权

本文介绍了如何使用Python编写简单的网络爬虫，从猫眼电影网站抓取当前热映电影的排行榜信息。通过requests库获取网页数据，再用BeautifulSoup解析HTML，提取出电影名称、评分等关键信息，实现自动化获取最新电影动态。

摘要由CSDN通过智能技术生成

# -*- coding:utf-8 -*-
import requests,time
from selenium import webdriver
from bs4 import BeautifulSoup
from collections import namedtuple
import xlwt


def main():
    url = "https://maoyan.com/board/7/"
    headers = {
   "user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36"}
    response = requests.get(url,headers=headers)
    soup = BeautifulSoup(response.text,features="lxml")
    all_dd = soup.find_all('dd')
    # dat = namedtuple("dy",['index','title','yanyuan','releasetime'])
    for d in all_dd:
        data = {
   }
        data["index"]  = d.find('i').get_text