基于python的爬虫系统_基于Python 的网络爬虫系统

摘要

通过Python和Scrapy框架的使用,实现了一个对电商商品和商品评价信息的爬取系统,文中详细地介绍了该系统的设计过程,能够完成需求中的功能,并且对所有爬取下来的数据进行了分析,对商品的不同品牌各类信息进行比对。

Through the use of Python and Scrapy framework,a crawling system for commercial mobile phone products and commodi ty evaluation information is realized.The design process of the system is introduced in detail,which can complete the functions in demand.All the crawled data are analyzed and the information of different brands of products is compared.