dir目录扫描经常出现这个错误:出现 \ufeff、\u202a等非法字符
当然也可以换dirsearch批量扫描:
python37.exe dirsearch.py -l url.txt --full-url -e * -x 500,503,502,400,301,302,404,406 -t 20 --random-agent --timeout=5
或者dirmap
python38 dirmap.py -iF url.txt -lcf
D:/t00ls/dir/dir_win-v1.5.1/ 修改路径,
.txt 可以同目录txt批量修改或者指定
import os, time
if __name__ == '__main__':
start = time.time()
directory = "D:/t00ls/dir/dir_win-v1.5.1/"
for cdir, subdirs, files in os.walk(directory):
for file in files:
if file.endswith(".txt"):
print(file)
bom_file = os.path.join(cdir, file)
s = open(bom_file, mode='r', encoding='utf-8-sig').read()
open(bom_file, mode='w', encoding='utf-8').write(s)
print("cost time: %.3fs" % (time.time() - start))