目录
代码:
#!/usr/bin/env python3
# -*- coding: utf-8 -*-
from lxml import etree
import requests
import csv
out = open('电影名网址评分及导演.csv', 'a', newline='')
csv_write = csv.writer(out, dialect='excel')
for a in range(10):
url = 'https://movie.douban.com/top250?start={}'.format(a * 25)
headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.104 Safari/537.36 Core/1.53.2669.400 QQBrowser/9.6.11215.400'}
data = requests.get(url, headers=headers).text
# print(data)
s = etree.HTML(data)
file = s.xpath("//*[@id='content']/div/div[1]/ol/li")
for div in file:
movies_name = div.xpath('./div/div[2]/div[1]/a/span[1]/text()')[0]
movies_score = div.xpath('./div/div[2]/div[2]/div/span[2]/text()')[0]
movies_href = div.xpath('./div/div[2]/div[1]/a/@href')[0]
# time.sleep(1)
csv_write.writerow([movies_name, movies_href, movies_score])
# print("{} {} {}".format(movies_name,movies_href,movies_score))
运行结果:
肖申克的救赎,https://movie.douban.com/subject/1292052/,9.7
霸王别姬,https://movie.douban.com/subject/1291546/,9.6
阿甘正传,https://movie.douban.com/subject/1292720/,9.5
这个杀手不太冷,https://movie.douban.com/subject/1295644/,9.4
美丽人生,https://movie.douban.com/subject/1292063/,9.5
泰坦尼克号,https://movie.douban.com/subject/1292722/,9.4
千与千寻,https://movie.douban.com/subject/1291561/,9.4
辛德勒的名单,https://movie.douban.com/subject/1295124/,9.5
盗梦空间,https://movie.douban.com/subject/3541415/,9.3
忠犬八公的故事,https://movie.douban.com/subject/3011091/,9.4
海上钢琴师,https://movie.douban.com/subject/1292001/,9.3
楚门的世界,https://movie.douban.com/subject/1292064/,9.3
三傻大闹宝莱坞,https://movie.douban.com/subject/3793023/,9.2
机器人总动员,https://movie.douban.com/subject/2131459/,9.3
放牛班的春天,https://movie.douban.com/subject/1291549/,9.3
星际穿越,https://movie.douban.com/subject/1889243/,9.3
大话西游之大圣娶亲,https://movie.douban.com/subject/1292213/,9.2
熔炉,https://movie.douban.com/subject/5912992/,9.3
疯狂动物城,https://movie.douban.com/subject/25662329/,9.2
无间道,https://movie.douban.com/subject/1307914/,9.2
龙猫,https://movie.douban.com/subject/1291560/,9.2
教父,https://movie.douban.com/subject/1291841/,9.3
当幸福来敲门,https://movie.douban.com/subject/1849031/,9.1
怦然心动,https://movie.douban.com/subject/3319755/,9.1
触不可及,https://movie.douban.com/subject/6786002/,9.2
蝙蝠侠:黑暗骑士,https://movie.douban.com/subject/1851857/,9.2
控方证人,https://movie.douban.com/subject/1296141/,9.6
活着,https://movie.douban.com/subject/1292365/,9.2
乱世佳人,https://movie.douban.com/subject/1300267/,9.3
寻梦环游记,https://movie.douban.com/subject/20495023/,9.1
末代皇帝,https://movie.douban.com/subject/1293172/,9.2
摔跤吧!爸爸,https://movie.douban.com/subject/26387939/,9.0
指环王3:王者无敌,https://movie.douban.com/subject/1291552/,9.2
何以为家,https://movie.douban.com/subject/30170448/,9.1
少年派的奇幻漂流,https://movie.douban.com/subject/1929463/,9.1
飞屋环游记,https://movie.douban.com/subject/2129039/,9.0
十二怒汉,https://movie.douban.com/subject/1293182/,9.4
鬼子来了,https://movie.douban.com/subject/1291858/,9.2
天空之城,https://movie.douban.com/subject/1291583/,9.1
大话西游之月光宝盒,https://movie.douban.com/subject/1299398/,9.0
哈尔的移动城堡,https://movie.douban.com/subject/1308807/,9.1
素媛,https://movie.douban.com/subject/21937452/,9.2
天堂电影院,https://movie.douban.com/subject/1291828/,9.2
罗马假日,https://movie.douban.com/subject/1293839/,9.0
闻香识女人,https://movie.douban.com/subject/1298624/,9.1
辩护人,https://movie.douban.com/subject/21937445/,9.2
哈利·波特与魔法石,https://movie.douban.com/subject/1295038/,9.0
搏击俱乐部,https://movie.douban.com/subject/1292000/,9.0
我不是药神,https://movie.douban.com/subject/26752088/,9.0
死亡诗社,https://movie.douban.com/subject/1291548/,9.1
教父2,https://movie.douban.com/subject/1299131/,9.2
指环王2:双塔奇兵,https://movie.douban.com/subject/1291572/,9.1
狮子王,https://movie.douban.com/subject/1301753/,9.0
窃听风暴,https://movie.douban.com/subject/1900841/,9.1
大闹天宫,https://movie.douban.com/subject/1418019/,9.3
指环王1:魔戒再现,https://movie.douban.com/subject/1291571/,9.0
两杆大烟枪,https://movie.douban.com/subject/1293350/,9.1
美丽心灵,https://movie.douban.com/subject/1306029/,9.0
饮食男女,https://movie.douban.com/subject/1291818/,9.1
猫鼠游戏,https://movie.douban.com/subject/1305487/,9.0
飞越疯人院,https://movie.douban.com/subject/1292224/,9.1
黑客帝国,https://movie.douban.com/subject/1291843/,9.0
钢琴家,https://movie.douban.com/subject/1296736/,9.2
V字仇杀队,https://movie.douban.com/subject/1309046/,8.9
本杰明·巴顿奇事,https://movie.douban.com/subject/1485260/,8.9
看不见的客人,https://movie.douban.com/subject/26580232/,8.8
让子弹飞,https://movie.douban.com/subject/3742360/,8.8
西西里的美丽传说,https://movie.douban.com/subject/1292402/,8.9
小鞋子,https://movie.douban.com/subject/1303021/,9.2
拯救大兵瑞恩,https://movie.douban.com/subject/1292849/,9.0
情书,https://movie.douban.com/subject/1292220/,8.9
穿条纹睡衣的男孩,https://movie.douban.com/subject/3008247/,9.1
音乐之声,https://movie.douban.com/subject/1294408/,9.0
绿皮书,https://movie.douban.com/subject/27060077/,8.9
美国往事,https://movie.douban.com/subject/1292262/,9.2
海蒂和爷爷,https://movie.douban.com/subject/25958717/,9.2
致命魔术,https://movie.douban.com/subject/1780330/,8.9
低俗小说,https://movie.douban.com/subject/1291832/,8.8
七宗罪,https://movie.douban.com/subject/1292223/,8.8
沉默的羔羊,https://movie.douban.com/subject/1293544/,8.8
蝴蝶效应,https://movie.douban.com/subject/1292343/,8.8
春光乍泄,https://movie.douban.com/subject/1292679/,8.9
禁闭岛,https://movie.douban.com/subject/2334904/,8.8
被嫌弃的松子的一生,https://movie.douban.com/subject/1787291/,8.9
心灵捕手,https://movie.douban.com/subject/1292656/,8.9
布达佩斯大饭店,https://movie.douban.com/subject/11525673/,8.8
阿凡达,https://movie.douban.com/subject/1652587/,8.7
剪刀手爱德华,https://movie.douban.com/subject/1292370/,8.7
勇敢的心,https://movie.douban.com/subject/1294639/,8.9
摩登时代,https://movie.douban.com/subject/1294371/,9.3
天使爱美丽,https://movie.douban.com/subject/1292215/,8.7
喜剧之王,https://movie.douban.com/subject/1302425/,8.7
致命ID,https://movie.douban.com/subject/1297192/,8.8
加勒比海盗,https://movie.douban.com/subject/1298070/,8.7
断背山,https://movie.douban.com/subject/1418834/,8.8
杀人回忆,https://movie.douban.com/subject/1300299/,8.8
狩猎,https://movie.douban.com/subject/6985810/,9.1
幽灵公主,https://movie.douban.com/subject/1297359/,8.9
哈利·波特与死亡圣器(下),https://movie.douban.com/subject/3011235/,8.8
请以你的名字呼唤我,https://movie.douban.com/subject/26799731/,8.9
阳光灿烂的日子,https://movie.douban.com/subject/1291875/,8.8
入殓师,https://movie.douban.com/subject/2149806/,8.8
重庆森林,https://movie.douban.com/subject/1291999/,8.7
小森林 夏秋篇,https://movie.douban.com/subject/25814705/,9.0
第六感,https://movie.douban.com/subject/1297630/,8.9
7号房的礼物,https://movie.douban.com/subject/10777687/,8.9
消失的爱人,https://movie.douban.com/subject/21318488/,8.7
红辣椒,https://movie.douban.com/subject/1865703/,9.0
小森林 冬春篇,https://movie.douban.com/subject/25814707/,9.0
爱在黎明破晓前,https://movie.douban.com/subject/1296339/,8.8
侧耳倾听,https://movie.douban.com/subject/1297052/,8.9
玛丽和马克思,https://movie.douban.com/subject/3072124/,8.9
一一,https://movie.douban.com/subject/1292434/,9.0
唐伯虎点秋香,https://movie.douban.com/subject/1306249/,8.6
告白,https://movie.douban.com/subject/4268598/,8.7
蝙蝠侠:黑暗骑士崛起,https://movie.douban.com/subject/3395373/,8.8
大鱼,https://movie.douban.com/subject/1291545/,8.8
阳光姐妹淘,https://movie.douban.com/subject/4917726/,8.8
倩女幽魂,https://movie.douban.com/subject/1297447/,8.7
超脱,https://movie.douban.com/subject/5322596/,8.9
射雕英雄传之东成西就,https://movie.douban.com/subject/1316510/,8.7
萤火之森,https://movie.douban.com/subject/5989818/,8.9
甜蜜蜜,https://movie.douban.com/subject/1305164/,8.8
驯龙高手,https://movie.douban.com/subject/2353023/,8.7
无人知晓,https://movie.douban.com/subject/1292337/,9.1
超能陆战队,https://movie.douban.com/subject/11026735/,8.7
幸福终点站,https://movie.douban.com/subject/1292274/,8.8
借东西的小人阿莉埃蒂,https://movie.douban.com/subject/4202302/,8.8
菊次郎的夏天,https://movie.douban.com/subject/1293359/,8.8
爱在日落黄昏时,https://movie.douban.com/subject/1291990/,8.8
恐怖直播,https://movie.douban.com/subject/21360417/,8.8
完美的世界,https://movie.douban.com/subject/1300992/,9.1
神偷奶爸,https://movie.douban.com/subject/3287562/,8.6
怪兽电力公司,https://movie.douban.com/subject/1291579/,8.7
玩具总动员3,https://movie.douban.com/subject/1858711/,8.8
风之谷,https://movie.douban.com/subject/1291585/,8.9
血战钢锯岭,https://movie.douban.com/subject/26325320/,8.7
功夫,https://movie.douban.com/subject/1291543/,8.6
傲慢与偏见,https://movie.douban.com/subject/1418200/,8.6
上帝之城,https://movie.douban.com/subject/1292208/,8.9
时空恋旅人,https://movie.douban.com/subject/10577869/,8.7
教父3,https://movie.douban.com/subject/1294240/,8.9
电锯惊魂,https://movie.douban.com/subject/1417598/,8.7
天书奇谭,https://movie.douban.com/subject/1428581/,9.2
喜宴,https://movie.douban.com/subject/1303037/,8.9
谍影重重3,https://movie.douban.com/subject/1578507/,8.8
英雄本色,https://movie.douban.com/subject/1297574/,8.7
被解救的姜戈,https://movie.douban.com/subject/6307447/,8.7
岁月神偷,https://movie.douban.com/subject/3792799/,8.7
七武士,https://movie.douban.com/subject/1295399/,9.2
哪吒闹海,https://movie.douban.com/subject/1307315/,9.1
我是山姆,https://movie.douban.com/subject/1306861/,8.9
疯狂原始人,https://movie.douban.com/subject/1907966/,8.7
纵横四海,https://movie.douban.com/subject/1295409/,8.8
头号玩家,https://movie.douban.com/subject/4920389/,8.7
三块广告牌,https://movie.douban.com/subject/26611804/,8.7
釜山行,https://movie.douban.com/subject/25986180/,8.5
心迷宫,https://movie.douban.com/subject/25917973/,8.7
萤火虫之墓,https://movie.douban.com/subject/1293318/,8.7
达拉斯买家俱乐部,https://movie.douban.com/subject/1793929/,8.8
真爱至上,https://movie.douban.com/subject/1292401/,8.6
荒蛮故事,https://movie.douban.com/subject/24750126/,8.8
贫民窟的百万富翁,https://movie.douban.com/subject/2209573/,8.6
东邪西毒,https://movie.douban.com/subject/1292328/,8.6
记忆碎片,https://movie.douban.com/subject/1304447/,8.6
爆裂鼓手,https://movie.douban.com/subject/25773932/,8.7
你的名字。,https://movie.douban.com/subject/26683290/,8.4
黑天鹅,https://movie.douban.com/subject/1978709/,8.6
花样年华,https://movie.douban.com/subject/1291557/,8.6
卢旺达饭店,https://movie.douban.com/subject/1291822/,8.9
哈利·波特与阿兹卡班的囚徒,https://movie.douban.com/subject/1291544/,8.7
忠犬八公物语,https://movie.douban.com/subject/1959195/,9.2
黑客帝国3:矩阵革命,https://movie.douban.com/subject/1302467/,8.7
模仿游戏,https://movie.douban.com/subject/10463953/,8.7
头脑特工队,https://movie.douban.com/subject/10533913/,8.7
一个叫欧维的男人决定去死,https://movie.douban.com/subject/26628357/,8.8
雨人,https://movie.douban.com/subject/1291870/,8.7
你看起来好像很好吃,https://movie.douban.com/subject/4848115/,8.9
哈利·波特与密室,https://movie.douban.com/subject/1296996/,8.6
未麻的部屋,https://movie.douban.com/subject/1395091/,8.9
无敌破坏王,https://movie.douban.com/subject/6534248/,8.7
恋恋笔记本,https://movie.douban.com/subject/1309163/,8.5
冰川时代,https://movie.douban.com/subject/1291578/,8.6
海街日记,https://movie.douban.com/subject/25895901/,8.8
新世界,https://movie.douban.com/subject/10437779/,8.8
海边的曼彻斯特,https://movie.douban.com/subject/25980443/,8.6
虎口脱险,https://movie.douban.com/subject/1296909/,8.9
房间,https://movie.douban.com/subject/25724855/,8.8
恐怖游轮,https://movie.douban.com/subject/3011051/,8.5
惊魂记,https://movie.douban.com/subject/1293181/,9.0
奇迹男孩,https://movie.douban.com/subject/26787574/,8.6
魔女宅急便,https://movie.douban.com/subject/1307811/,8.6
人工智能,https://movie.douban.com/subject/1302827/,8.6
雨中曲,https://movie.douban.com/subject/1293460/,9.0
疯狂的石头,https://movie.douban.com/subject/1862151/,8.5
罗生门,https://movie.douban.com/subject/1291879/,8.8
爱在午夜降临前,https://movie.douban.com/subject/10808442/,8.8
小偷家族,https://movie.douban.com/subject/27622447/,8.7
终结者2:审判日,https://movie.douban.com/subject/1291844/,8.7
初恋这件小事,https://movie.douban.com/subject/4739952/,8.4
魂断蓝桥,https://movie.douban.com/subject/1293964/,8.8
燃情岁月,https://movie.douban.com/subject/1295865/,8.8
可可西里,https://movie.douban.com/subject/1308857/,8.8
绿里奇迹,https://movie.douban.com/subject/1300374/,8.8
穿越时空的少女,https://movie.douban.com/subject/1937946/,8.6
2001太空漫游,https://movie.douban.com/subject/1292226/,8.8
牯岭街少年杀人事件,https://movie.douban.com/subject/1292329/,8.8
完美陌生人,https://movie.douban.com/subject/26614893/,8.5
城市之光,https://movie.douban.com/subject/1293908/,9.3
无耻混蛋,https://movie.douban.com/subject/1438652/,8.6
阿飞正传,https://movie.douban.com/subject/1305690/,8.5
新龙门客栈,https://movie.douban.com/subject/1292287/,8.6
源代码,https://movie.douban.com/subject/3075287/,8.4
香水,https://movie.douban.com/subject/1760622/,8.5
谍影重重2,https://movie.douban.com/subject/1308767/,8.6
青蛇,https://movie.douban.com/subject/1303394/,8.5
地球上的星星,https://movie.douban.com/subject/2363506/,8.9
谍影重重,https://movie.douban.com/subject/1304102/,8.6
战争之王,https://movie.douban.com/subject/1419936/,8.6
色,戒,https://movie.douban.com/subject/1828115/,8.4
血钻,https://movie.douban.com/subject/1428175/,8.7
猜火车,https://movie.douban.com/subject/1292528/,8.5
遗愿清单,https://movie.douban.com/subject/1867345/,8.6
大佛普拉斯,https://movie.douban.com/subject/27059130/,8.7
疯狂的麦克斯4:狂暴之路,https://movie.douban.com/subject/3592854/,8.6
步履不停,https://movie.douban.com/subject/2222996/,8.8
彗星来的那一夜,https://movie.douban.com/subject/25807345/,8.5
朗读者,https://movie.douban.com/subject/2213597/,8.6
浪潮,https://movie.douban.com/subject/2297265/,8.7
小萝莉的猴神大叔,https://movie.douban.com/subject/26393561/,8.4
再次出发之纽约遇见你,https://movie.douban.com/subject/6874403/,8.5
驴得水,https://movie.douban.com/subject/25921812/,8.3
聚焦,https://movie.douban.com/subject/25954475/,8.8
东京物语,https://movie.douban.com/subject/1291568/,9.2
追随,https://movie.douban.com/subject/1397546/,8.9
一次别离,https://movie.douban.com/subject/5964718/,8.7
九品芝麻官,https://movie.douban.com/subject/1297518/,8.5
千钧一发,https://movie.douban.com/subject/1300117/,8.8
哈利·波特与火焰杯,https://movie.douban.com/subject/1309055/,8.5
我爱你,https://movie.douban.com/subject/5908478/,9.0
黑鹰坠落,https://movie.douban.com/subject/1291824/,8.7
网络谜踪,https://movie.douban.com/subject/27615441/,8.6
发条橙,https://movie.douban.com/subject/1292233/,8.5
E.T. 外星人,https://movie.douban.com/subject/1294638/,8.6
黑客帝国2:重装上阵,https://movie.douban.com/subject/1304141/,8.6
波西米亚狂想曲,https://movie.douban.com/subject/5300054/,8.7
变脸,https://movie.douban.com/subject/1292659/,8.5
末路狂花,https://movie.douban.com/subject/1291992/,8.8
撞车,https://movie.douban.com/subject/1388216/,8.6
梦之安魂曲,https://movie.douban.com/subject/1292270/,8.7