爬取“豆瓣电影Top250”的电影排名、电影名和评分并写入文档

想要爬取豆瓣电影Top250的电影排名、电影名和评分并写入文档吗？其实很简单。

1. 打开Pycharm
2. 得到豆瓣电影Top250的网址：
   https://movie.douban.com/top250?start=0&filter=
3. 接下来是我的代码：

from urllib.request import urlopen, Request
from bs4 import BeautifulSoup
import re
for x in range(0,250,25):
    url=("https://movie.douban.com/top250?start="+str(x))+"&filter="
    header = {'User-Agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/85.0.4183.102 Safari/537.36'}
    ret = Request(url, headers=header)
    html=urlopen(ret)
    name1s=[]
    bs = BeautifulSoup(html,'html.parser')
    numbers=bs.find_all("em",{ "class":""})
    names = bs.find_all("span",{"class":"title"})
    scores = bs.find_all("span",{"class":"rating_num"})
    for name in names:
        name = name.get_text()
        if name[1] !='/' :
            name1s.append(name)
    for number,name1,score in zip(numbers,name1s,scores,) :
        number = number.get_text()
        score = score.get_text()
        print(number,name1,score)
        list = [str(number)+ name1+ str(score)]
        sep = ','
        fl=open('douban.txt', 'a')
        fl.write(sep.join(list)+'\r\n')
        fl.close()

可以试试运行一下哦！