python 获取企名科技数据

远方的飞猪

已于 2023-07-30 14:43:27 修改

阅读量573

点赞数 1

分类专栏：爬虫 Python 文章标签： python

于 2020-09-20 11:04:16 首次发布

本文链接：https://blog.csdn.net/tanjunchen/article/details/108675868

版权

爬虫同时被 2 个专栏收录

22 篇文章 4 订阅

订阅专栏

Python

21 篇文章 1 订阅

订阅专栏

#!/usr/bin/env python
# -*- coding: utf-8 -*-

import execjs
import base64
import json
import requests

headers = {
    'Accept': 'application/json, text/plain, */*',
    'Content-Type': 'application/x-www-form-urlencoded',
    'Origin': 'https://www.qimingpian.com',
    'Referer': 'https://www.qimingpian.com/finosda/project/pinvestment',
    'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36',
}

data = {
    'time_interval': '',
    'tag': '',
    'tag_type': '',
    'province': '',
    'lunci': '',
    'page': 1,
    'num': 20,
    'unionid': '',
}


def decrypt(encrypt_data):
    ctx = execjs.compile(open('data.js').read())
    return base64.b64decode(ctx.call('my_decrypt', encrypt_data))


def get_str():
    url = "https://vipapi.qimingpian.com/DataList/productListVip"
    content = requests.post(url, data=data)
    content.encoding = "utf-8"
    if content.ok and content.json() is not None:
        return content.json().get("encrypt_data")
    return None


def get_data():
    str_data = get_str()
    decrypt_data = decrypt(str_data)
    json_data = json.loads(decrypt_data)
    return json_data


if __name__ == '__main__':
    print(get_data())

完整代码下载：https://github.com/tanjunchen/SpiderProject/tree/master/qimingpian