scrapy
joker_zhou
这个作者很懒,什么都没留下…
展开
-
scrapy 笔记一
creating a project: enter "scrapy startproject tutorial” in your console.This will create directory named tutorial ,it likes following:tutorial/ scrapy.cfg # deploy configuration file...原创 2018-07-04 09:20:24 · 169 阅读 · 0 评论 -
Scrapy 学习笔记二 Command line tool
Creating projects: scrapy startproject /projectname/ [project_dir]This command will create new project under the project_dir directory.Controlling projects:1.create new spider: scrape genspider spider...原创 2018-07-04 10:44:21 · 179 阅读 · 0 评论 -
Scrapy 笔记本四 (scrapy shell)
Scrapy shellScrapy shell is a shell like unit shell, but you can run your scraping code very quickly without having to run the spider.You can debug your code in it.You can testing your XPath and Css e...原创 2018-07-04 13:48:02 · 113 阅读 · 0 评论 -
Scrapy shell problem
I got a error when i running “scrapy shell” command in my terminal。Virtualenvs/scrapy_env/lib/python3.7/site-packages/twisted/conch/manhole.py", line 154 def write(self, data, async=False):I'm so ...原创 2018-07-04 14:03:25 · 719 阅读 · 0 评论 -
Scrapy 笔记(四) Simple spider
Spiders: To scrape data from website。You will define the spiders class when after create project。Spiders are classes which define how to scrape data。Scraping cycle:For spiders, the scraping cycle goes...原创 2018-07-04 15:37:36 · 214 阅读 · 0 评论 -
running Scrapy but it error: No module named _util
=, = So you need upgrade pyopensslrunning following command in your terminal。sudo pip install pyopenssl --user --upgrade原创 2018-07-04 16:27:35 · 1630 阅读 · 0 评论