成功解决在已经安装pywin32的情况下启动爬虫还是报错: builtins.NotImplementedError: spawnProcess not available since pywin32 is not installed.
一、错误现象
使用scrapyd命令启动远程爬虫程序:
curl http://localhost:6800/scheduler.json-d project=myproject -d spider=myspider
执行后,显示执行成功,但是爬虫程序没有运行起来,打开scrapyd的启动窗口中,显示如下错误:
2023:06:58:22 +0000] "POST /schedule.json HTTP/1.1" 200 94 "-" "curl/7.83.1"
2023-04-06T14:58:26+0800 [twisted.internet.defer#critical] Unhandled error in De
ferred:
2023-04-06T14:58:26+0800 [twisted.internet.defer#critical]
Traceback (most recent call last):
File "c:\users\administrator\appdata\local\programs\python\python38\li
b\site-packages\scrapyd\poller.py", line 25, in poll
returnValue(self.dq.put(self._me