一.windows下部署scrapy 本地
1.installs
a. 安装客户端 (py3scrapy) C:\Users\liuyc>pip install scrapyd-client 主要用来打包爬虫项目
b. linux: 可以直接运行打包 (py3scrapy) C:\LinuxShare\ArticleSpider\ArticleSpider>scrapyd-deploy
windows:下必须在 C:\Envs\py3scrapy\Scripts 虚拟环境的文件下建立 scrapyd-deploy.bat
内容为:
@echo off
"C:\Envs\py3scrapy\Scripts\python.exe" "C:\Envs\py3scrapy\Scripts\scrapyd-deploy" %1 %2 %3 %4 %5 %6 %7 %8 %9
修改项目中C:\LinuxShare\ArticleSpider\scrapy.cfg内容:去掉url前面的#
[deploy:liuyc]
url = http
1.installs
a. 安装客户端 (py3scrapy) C:\Users\liuyc>pip install scrapyd-client 主要用来打包爬虫项目
b. linux: 可以直接运行打包 (py3scrapy) C:\LinuxShare\ArticleSpider\ArticleSpider>scrapyd-deploy
windows:下必须在 C:\Envs\py3scrapy\Scripts 虚拟环境的文件下建立 scrapyd-deploy.bat
内容为:
@echo off
"C:\Envs\py3scrapy\Scripts\python.exe" "C:\Envs\py3scrapy\Scripts\scrapyd-deploy" %1 %2 %3 %4 %5 %6 %7 %8 %9
修改项目中C:\LinuxShare\ArticleSpider\scrapy.cfg内容:去掉url前面的#
[deploy:liuyc]
url = http