《复联4》影评抓取+词云+情感分析

复联4上映了！这次比美国还早了两天。很多人都去看了首映，各大媒体都被它刷屏。小编也是漫威迷，看了很多相关文章，觉得挺感兴趣的（文末有链接）因此也想搞搞事情，回顾一下从入门到放弃再到拾起的python，顺便蹭蹭热度。本文是比较简单入门级的操作，深入的以后有机会再写~

1.文本准备

使用beautifulsoup抓取豆瓣《复仇者联盟4》的影评（前20页）
目标url： https://movie.douban.com/subject/26100958/
代码如下：

import urllib.request
from bs4 import BeautifulSoup
def getHtml(url):
    """获取url页面"""
    headers = {'User-Agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.94 Safari/537.36'}
    req = urllib.request.Request(url,headers=headers)
    req = urllib.request.urlopen(req)
    content = req.read().decode('utf-8')

    return content

def getComment(url):
    """解析HTML页面"""
    html = getHtml(url)
    soupComment = BeautifulSoup(html, 'html.parser')

    comments = soupComment.findAll('span', 'short')
    onePageComments = []
    for comment in comments:
        # print(comment.getText()+'\n')
        onePageComments.append(comment.getText()+'\n')

    return onePageComments

if __name__ == '__main__':
    f = open('复联4.txt', 'w', encoding='utf-8') 
    for page in range(10):  # 豆瓣爬取多页评论需要验证。
        url = 'https://movie.douban.com/su