爬虫
fanxiangs
这个作者很懒,什么都没留下…
展开
-
Scrapy深入之认识setting文件(随机UA)
# -*- coding: utf-8 -*- # Scrapy settings for demo1 project## For simplicity, this file contains only settings considered important or# commonly used. You can find more settings consulting the do...原创 2019-01-11 16:04:25 · 395 阅读 · 0 评论 -
爬虫数据存入MongoDB
Scrapy+pymongo首先开启本地的MongoDB服务sudo service mongodb start在settings.py文件中添加数据库的配置项MONGO_HOST = "127.0.0.1" # 主机IPMONGO_PORT = 27017 # 端口号MONGO_DB = "Spider" # 库名 MONGO_COLL = "heartsong" # ...原创 2019-01-11 17:25:32 · 1766 阅读 · 0 评论