unpkg项目文件下载到本地-Rust

最新推荐文章于 2024-10-17 11:59:10 发布

FIOAF

最新推荐文章于 2024-10-17 11:59:10 发布

阅读量1.6k

点赞数

文章标签： rust 爬虫

本文链接：https://blog.csdn.net/FIOAF/article/details/118468540

版权

Rust 网络爬虫 reqwest 多线程文件下载

关键词由CSDN通过智能技术生成

自己写的当Rust练习了，写的不咋地但是能用

use std::thread;
use std::result::Result;

use reqwest::Error as reqwest_err;
use reqwest::header::{HeaderMap, HeaderValue, IntoHeaderName};
use std::fs::{OpenOptions, create_dir_all};
use std::io::Write;
use std::sync::{Arc, Mutex};


fn main(){
    let path_url:String = String::from("https://unpkg.com/browse/react@16.7.0/");
    let file_url:String = String::from("https://unpkg.com/react@16.7.0/");
    let file_path:String = String::from("./result/react@16.7.0");
    let r = ReadTarget::new(path_url, file_url,file_path);
    let mut i = r.scan_item().unwrap();
    r.read_file(i);
}

pub struct ReadTarget {
    path_url:String,
    file_url:String,
    file_path:String,
    headers:HeaderMap<HeaderValue>,
    max_task:usize
}

impl ReadTarget{
    pub fn scan_item(&self) ->Result<Vec<String>,reqwest_err>{
        let mut file_vec:Vec<String> = Ve