格式化浏览器的headers

FlowLiver

于 2022-11-26 22:51:23 发布

阅读量444

点赞数

分类专栏： Python Python爬虫文章标签： python 开发语言

CSDN@FlowLiver

本文链接：https://blog.csdn.net/qq_40067488/article/details/128058700

版权

Python 同时被 2 个专栏收录

3 篇文章 1 订阅

订阅专栏

Python爬虫

3 篇文章 1 订阅

订阅专栏

# -*- coding: utf-8 -*-
import pprint
import re


def getHeaders():
    with open('./headers.txt', 'r', encoding='utf-8') as rf:
        ll = rf.readlines()
        ll = [re.sub(re.compile(r'\s+', re.S), '', item) for item in ll if item != '']
        keys = [line.split(':')[0] for line in ll]
        values = [line[line.find(':', 0, len(line)) + 1:len(line)] for line in ll]
        headers = {k: v for k, v in zip(keys, values)}
        if 'Accept-Encoding' in keys:
            headers['Accept-Encoding'] = 'utf-8'
        if 'accept-encoding' in keys:
            headers['accept-encoding'] = 'utf-8'
        print('headers=', end='')
        pprint.pprint(headers)


if __name__ == '__main__':
    getHeaders()