python网络爬虫

192-168-20-21

已于 2022-04-07 14:16:42 修改

阅读量372

点赞数

分类专栏： python爬虫文章标签： python 爬虫 html

于 2021-12-22 19:27:17 首次发布

本文链接：https://blog.csdn.net/weixin_45373745/article/details/122093217

版权

python爬虫专栏收录该内容

1 篇文章 0 订阅

订阅专栏

# -*- coding: utf-8 -*-
"""
Created on Tue Dec 21 20:04:58 2021

@author: three-kilomters
"""

#获取数据，网络爬虫

import requests
import time
from bs4 import BeautifulSoup

#通过requests请求到电影票房的网页

header = {
        "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.110 Safari/537.36 Edg/96.0.1054.62"
        }

text = requests.get("https://top.zol.com.cn/manu/",headers = header).text

main_page = BeautifulSoup(text, "html.parser")

div_main = main_page.find("div", attrs={"class": "_j_brand_rank_box brand-rank__list"})

f = open("phone.csv", mode="a")

divs = div_main.find_all("div")

for item in divs:
    lst = item.find_all("div")
    if len(lst) != 0:
        for div in lst:
            #print(div.text)
            f.write(div.text)
            f.write(",")
        f.write("\n")