python广告爬虫_Python3网络爬虫：腾讯新闻App的广告数据抓取

最新推荐文章于 2024-05-02 00:13:50 发布

weixin_39731456

最新推荐文章于 2024-05-02 00:13:50 发布

阅读量1.9k

点赞数

文章标签： python广告爬虫

本文链接：https://blog.csdn.net/weixin_39731456/article/details/111796414

版权

废话就不说了，咱们直接上代码

def startGetData(self):

index = 0

while index < 3:

index = index + 1

self.url = "http://r.inews.qq.com/getQQNewsUnreadList?idfa=18454932-A441-4720-8973-776284A58B7F&apptype=ios&rtAd=1&screen_height=667&network_type=wifi&" \

"store=1&activefrom=&global_info=0%7C1%7C1%7C1%7C1%7C4%7C2%7C1%7C2%7C0%7C1%7C2%7C2%7C0%7C&screen_scale=2&adcode=440112&screen_width=375&__qnr=2" \

"08e" + str(

self.getRondomStr()) + "&isJailbreak=1&qqnews_refpage=QNLaunchWindowViewController&omgid=96192500048fe94e120b203d6b2be528edb2001011321e&device_model=iPhone7%2" \

"C2&pagestartFrom=icon&startFrom=icon&startarticleid=&devid=F3D6D07C-4D87-40B5-8533-A6E8D1331C89&omgbizid=1a9a8d53c482a14b7e7bd33737409def8cae006011" \

"321e&appver=9.3.1_qqnews_5.5.60"

time.sleep(2)

self.parse_url(self.url, self.getBody(), self.getHeader())

这个是启动函数

def parse_url(self, url, body, header):

response = requests.post(url, data=body, headers=header, verify=False)

self.parse_json(response.content.decode("utf-8"))

网络抓取数据

def getBody(self):

body = "cachedC