依据BaiduHack多线程爬取攻击点url和网站url，保存至txt

依据BaiduHack多线程爬取攻击点url和网站url，保存至txt

使用了多线程，队列，元组去重，正则匹配，bs4，sys.arg手工传入参数等技术

#!/usr/bin/env python
# -*- coding: utf-8 -*-

import requests
import sys
from queue import Queue
import threading
from bs4 import BeautifulSoup as bs
import re

# 百度查询语句 inurl:news_detail.php?id=

headers = {
   
    'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/85.0.4183.121 Safari/537.36'}

# 使用元组来去重
quchong = set()
quchong_root = set()


class BaiduSpider(threading.Thread):
    def __init__(self, queue):

        threading.Thread.__init__(self)
        self.queue = queue

    def run(self):
        while not self.queue.empty():
            url = self.queue