x631617479的博客

scrapyd 环境搭建项目发布及运行关于python相关的资料中文比较匮乏，记录一下自己搭建成功的例子：环境搭建下载安装scrapydpip install scrapydpip install scrapyd-client启动scrapyd服务器在命令行中输入 scrapyd 看到类似 running 字样在浏览器中输入http://localhost:6800/ 进入scrapyd管

settting中配置DOWNLOADER_MIDDLEWARES = { 'scrapy.contrib.downloadermiddleware.useragent.UserAgentMiddleware' : None, 'randoms.rotate_useragent.RotateUserAgentMiddleware' :400 #项目名.(包名).