爬虫之爬取小说

爬虫之爬取小说

展示

在这里插入图片描述
在这里插入图片描述
在这里插入图片描述

源码地址

https://github.com/Liar0320/spider

依赖

  • cherrio Fast, flexible & lean implementation of core jQuery designed specifically for the server.
  • inquirer A collection of common interactive command line user interfaces.

安装

Clone the repo using Git:

git clone https://github.com/Liar0320/spider.git

Alternatively you can download this repository and then:

npm i 
npm run start 

配置参数

请求的超时时间

Timeout for each request.

default value: 15000

最大同时下载多少章节

The maximum number of threads that exist at one time, that is, the number of asynchronous downloads that are started at the same time.

default value: 20

请求失败时,重新发起请求的次数

The number of times the request was re initiated if there was a request failure.

default value: 4

下载的目录

Root of download directory

default value: join(__dirname, ‘./download’)

©️2020 CSDN 皮肤主题: 大白 设计师: CSDN官方博客 返回首页
实付0元
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、C币套餐、付费专栏及课程。

余额充值