爬取全国建筑公司信息，普通的AES解密，但是有陷阱，基于响应器去确定位置。

努力学习各种软件

已于 2024-03-14 16:32:08 修改

阅读量738

点赞数 15

分类专栏：爬虫逆向专栏文章标签： python 爬虫

于 2024-03-14 16:08:58 首次发布

本文链接：https://blog.csdn.net/m0_57265868/article/details/136712878

版权

爬虫逆向专栏专栏收录该内容

11 篇文章 2 订阅

订阅专栏

一、代码和具体结果展现

1.1python代码展现

import csv

import requests
import execjs
import json
import time

f = open('全国建筑公司信息.csv','w',encoding='utf-8',newline='')
csv_writer = csv.DictWriter(f,fieldnames=[
        '统一社会信用代码',
        '企业名称',
        '企业法定代表人',
        '企业注册属地',
        'COLLECT_TIME',
        'RN',
        'QY_ID',
        'OLD_CODE',
])
csv_writer.writeheader()
cookies = {
    'Hm_lvt_b1b4b9ea61b6f1627192160766a9c55c': '1710333577,1710398146',
    'Hm_lpvt_b1b4b9ea61b6f1627192160766a9c55c': '1710398146',
}

headers = {
    'Accept': 'application/json, text/plain, */*',
    'Accept-Language': 'zh-CN,zh;q=0.9',
    'Connection': 'keep-alive',
    # 'Cookie': 'Hm_lvt_b1b4b9ea61b6f1627192160766a9c55c=1710333577,1710398146; Hm_lpvt_b1b4b9ea61b6f1627192160766a9c55c=1710398146',
    'Referer': 'https://jzsc.mohurd.gov.cn/data/company',
    'Sec-Fetch-Dest': 'empty',
    'Sec-Fetch-Mode': 'cors',
    'Sec-Fetch-Site': 'same-origin',
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36',
    'accessToken': '',
    'sec-ch-ua': '"Not_A Brand";v="8", "Chromium";v="120", "Google Chrome";v="120"',
    'sec-ch-ua-mobile': '?0',
    'sec-ch-ua-platform': '"Windows"',
    'timeout': '30000',
    'v': '231012',
}
for page in range(1,30):
    time.sleep(1)
    params = {
        'pg': page,
        'pgsz': '15',
        'total': '450',
    }

    response = requests.get(
        'https://jzsc.mohurd.gov.cn/APi/webApi/dataservice/query/comp/list',params=params,cookies=cookies, headers=headers,).text

    js_file = execjs.compile(open('爬取全国建筑公司信息.js','r',encoding='utf-8').read())
    json_data = json.loads(js_file.call('b',response))

    for index in json_data['data']['list']:
        dit = {
            '统一社会信用代码':index['QY_ORG_CODE'],
            '企业名称':index['QY_NAME'],
            '企业法定代表人':index['QY_FR_NAME'],
            '企业注册属地':index['QY_REGION_NAME'],
            'COLLECT_TIME':index['COLLECT_TIME'],
            'RN':index['RN'],
            'QY_ID':index['QY_ID'],
            'OLD_CODE':index['OLD_CODE'],

        }
        print(dit)
        csv_writer.writerow(dit)
    print(f'正在打印第{page}页数据---------------------------------------------------------------')

1.2js代码展现

const CryptoJS = require('crypto-js');

var m = CryptoJS.enc.Utf8.parse("0123456789ABCDEF");
var f = CryptoJS.enc.Utf8.parse("Dt8j9wGw%6HbxfFn");

function b(t) {
    var e = CryptoJS.enc.Hex.parse(t)
        , n = CryptoJS.enc.Base64.stringify(e)
        , a = CryptoJS.AES.decrypt(n, f, {
        iv: m,
        mode: CryptoJS.mode.CBC,
        padding: CryptoJS.pad.Pkcs7
    })
        , r = a.toString(CryptoJS.enc.Utf8);
    return r.toString()
}