qq_51474032的博客

原创 2021-06-24

原创 2021-06-17

**demo1**from sklearn.cluster import KMeansimport numpy as npnp.random.randint(666)def keansdemo():# 读取文件file=open(“city.txt”,encoding=“utf-8”)cityName=[] # 保存省份名称cityData=[] # 保存省份数据for line in file:items=line.split(",")cityName.append(items

原创 python中常见的问题解决3

class Sanguospider(scrapy.Spider):name = “threespider”allowed_domains=[“book.douban.com”]start_urls=[“https://book.douban.com/subject/1019568/comments/”]def parse(self, response, **kwargs):data=response.css(“div.comment span.short::text”).extract()da

原创 Python中常见问题2

spiders文件夹下创建python文件 ganspider.pyimport scrapyfrom demo6.items import HouseItemclass GanJiSpider(scrapy.Spider):name=“gan_spider”allowed_domains=[“xiangyang.ganji.com”]start_urls=[“http://xiangyang.ganji.com/zufang/”]解析数据def parse(self, response,

原创 python常见问题1

实训考题：根据豆瓣读书top250,根据出版社对书籍数量分类，绘制饼图一、爬虫–scrapy1.搭建环境2.加载scrapy框架3. setting配置4.spider编写测试5. 获取数据（书名+出版社)import scrapyimport numpy as npimport pandas as pdimport matplotlib.pyplot as pltterminal 终端实现cd … # 跳转到上一层目录scrapy startproject booktop #