python爬虫requests实战_Python_爬虫_requests小实战

1 爬取豆瓣电影中更多的电影详情数据（数据以获取但还没分析。）2 importrequests3 headers ={4 "User-Agent": "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36"

5 }6 #https://movie.douban.com/j/chart/top_list?type=10&interval_id=100%3A90&action=&start=0&limit=1//悬疑7 #https://movie.douban.com/j/chart/top_list?type=17&interval_id=100%3A90&action=&start=0&limit=20/科幻8 #https://movie.douban.com/j/chart/top_list?type=11&interval_id=100%3A90&action=&start=0&limit=20//剧情9 #https://movie.douban.com/j/chart/top_list?type=24&interval_id=100%3A90&action=&start=0&limit=20//喜剧10 #https://movie.douban.com/j/chart/top_list?type=13&interval_id=100%3A90&action=&start=0&limit=20//爱情11 #https://movie.douban.com/j/chart/top_list?type=25&interval_id=100%3A90&action=&start=0&limit=20//动画12 url_secelt ={13 "动作":"5",14 "悬疑":"10",15 "科幻":"17",16 "剧情":"11",17 "喜剧":"24",18 "爱情":"13",19 "动画":"25"

20 }21 user_movie = input("请输入电影类型 \n目前只支持搜索：动作 喜剧 科幻 剧情 爱情 动画 悬疑 \n")22 url = 'https://movie.douban.com/j/chart/top_list?type={}&interval_id=100%3A90&action=None'.format(url_secelt[user_movie])23 for i in range(0,800,20):24 param ={25 "start":i,26 "limit":"20"

27 }28 res = requests.get(url=url,params=param,headers=headers)29 content =res.json()30 stats =res.headers31 if content ==[]:32 break

33 print(content)34 try:35 if not stats["Vary"]:36 pass

37 except:38 break