爬取2021年天猫平台儿童推车畅销单品评价生成词云图

---

前言

了解用户对相应畅销单品的看法，研究用户的关注点，为用户调研问卷设计增加参考，下面以2021年度天猫平台畅销单品elittle逸乐途婴儿推车为例，爬取用户评论，使用在线分词工具生成词云图。

一、爬取天猫评论

1.代码

（1）查看首页-评价-右键-显示网页源代码，发现评价数据不在网址文本中，点击F12，刷新，按搜索🔍
在搜索框中搜索具体的评价数据，找到相关网址；

（2）爬取前20页数据，得到400条评价，保存到文本文件中。
代码如下：

import re
import requests
import csv
from requests.packages.urllib3.exceptions import InsecureRequestWarning
requests.packages.urllib3.disable_warnings(InsecureRequestWarning)
for i in range(20):
        url = 'https://rate.tmall.com/list_detail_rate.htm?itemId=556822500172&spuId=844343369&sellerId=2776482990&order=3&currentPage='+str(i)+'append=0&content=1&tagId=&posi=&picture=&groupId=&ua=098%23E1hvF9v8vnWvUvCkvvvvvjiWRLFWtjiRPs5ygjljPmPOgj3CRsqhtjYWRscwQjDCdvhvhyDnoBCKvhCbEZ4Y%2BX4ARhQAZs9CvvBvpvvvvvhvCyCCvvvvvv9Cvh12dJ6vITtiBoyZD70OVC6kayqhzC0wwhaAcreYr2E9Zj%2BO3w0AhjanWDNBlLyzOvZf8jc6%2BulsberESfZBHkyZw6d90COqb6OyCW2%2BKvhv8hCvvbNMM6mBphvpmQvvpGrvpCQmvvChNhCvjvUvvhR6phvwv9vvpqoUvpvjpyUW2E9Ow89Cvv3vpvpVeboAxQgCvvpvvPMMi9hvChCvCCoVvpvhphhvvv%3D%3D&needFold=0&_ksTS=1654391440696_566&callback=jsonp567'
        headers = {'referer': 'https://detail.tmall.com/item.htm?id=556822500172',
                'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/100.0.4896.127 Safari/537.36',
                'Cookie':'dnk=tb0437215_2012; uc1=cookie15=V32FPkk/w0dUvg==&cookie21=W5iHLLyFeYZ1WM9hVnmS&pas=0&cookie14=UoexNgbBR3bNuA==&existShop=true&cookie16=UIHiLt3xCS3yM2h4eKHS9lpEOw==; uc3=nk2=F5RFhB0xIyO574A51+Y=&id2=W877khZ/PiSw&lg2=UtASsssmOIJ0bQ==&vt3=F8dCvCwpnjQwLZ7NQMs=; tracknick=tb0437215_2012; uc4=nk4=0@FY4O7bKMWEuKqvKnB2BOg6+kH0sofL+CuQ==&id4=0@We1t7uVFopc90LWSr4qjt/tCzWQ=; _l_g_=Ug==; unb=876194655; lgc=tb0437215_2012; cookie1=UUtKLhPRUKtURwaAjfUSIF12BlYdmAd7SwSjgA1FZeg=; login=true; cookie17=W877khZ/PiSw; cookie2=13c115f52c9042b782b4ce350816478a; _nk_=tb0437215_2012; sgcookie=E100jtVUQAovLGCXqF6ID44S2Ehcedx0Qv6/nCn/uGoEMkPTcoyMGJfmLxMXTcwUzgW32UkVEcmQoU6cfXlxxGRdZy1vLes08KLA0x4nixALgKc=; cancelledSubSites=empty; t=c3b04be93396db0f11c26c9affde14aa; sg=253; csg=e53cd863; _tb_token_=7ee7be15ee375; cna=k/GkGTDxdQICASRwPorxunT2; xlly_s=1; x5sec=7b22617365727665723b32223a22366566373139376161326232656339316430653064336139376239346563373643502b42384a5147454d37642b59536d306454546c414561437a67334e6a45354e4459314e5473784d4b323673367743227d; pnm_cku822=098#E1hvDvvUvbZvUvCkvvvvvjiWRLFWtji8nLMpQjljPmPwQjn8n2dw1jDUPLsWgjr8kvhvC6Em2vAOVjmIvpvUphvhCi9A/VJgvpvIphvvcvvvphCvpCQmvvC2A6CvjvUvvhBGphvwv9vvpqBvpCQmvvC2rv9Cvh12S69vIThSoAZnD70Oe366fvDr1EkKNB9f8+BlDfUf85WK+87JVznHwDqXSfpAOHvYp8mtHdDSccpUQ8oaWLEcUZd+FfmtEpxAoUoXvvhvCyCCvvvvvvgCvvpvvPMMRvhvChCvvvmevpvhphvhHv==; enc=W9Q+YudSShVN5JXTombv4oqMelrxxusTE+CqYMobsO0jwuo4t6U4P7cQG9yuerDo20cZW8aOP+y0JBkW/3gasg==; tfstk=cwECByTLi7ENIv7yYJ6N82H54uiFaNJjFwG3d1p5lEehKMwo6sDB0j9GczA-4YH1.; l=eBr2AX0HL4E3aU7yBO5Churza77TBQRf5oVzaNbMiInca66dZFw2GNChp9ZwodtjgtfFWetyeRquUdewWeaNwCvfW25REpZNoYve-; isg=BGxstsBmIqPDXjafd7VSXGtSPUyeJRDPu0Zw1savgpW10QXb7jdFX3kj9Znp3Egn',
                'Accept-Encoding':'gzip, deflate, br',
                'Accept-Language':'zh-CN,zh;q=0.9',
                'Accept':'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9'}
        s=requests.session()
        res=s.get(url,headers=headers,stream=True, verify=False, allow_redirects=False)
        page_content=(res.text)
        print(page_content)
        result = re.compile(r'"rateContent":"(?P<index1>.*?)".*?"fromMall"', re.S)
        result = result.finditer(page_content)
        f = open("tianmao1.csv", mode="a")
        csvwriter = csv.writer(f)
        for it in result:
                dic = it.groupdict()
                csvwriter.writerow(dic.values())
        f.close()

二、在线生成词云

1.微词云

网址：www.weiciyun.com

2.使用技巧

（1）粘贴复制文本

选择分词筛词后导入

（2）分词性筛选需要的词语

词性中形容词与动词是我们最关注的，筛选相关词语，可下载词语+词频生成的excel到本地。

（3）生成词云图

生成词云图，可看到质量、外观好看、顺滑、方便是用户比较关注的点。

总结

本文通过爬取2021年天猫平台儿童推车畅销单品elittle逸乐途婴儿推车评价，运用线上分词工具，最终得出质量、外观好看、顺滑、方便是儿童推车用户比较关注的点，为后续问卷调研提供参考。