Ajax
Z_sam
成伪砖家
展开
-
微博ajax抓取(转)
import requests from urllib.parse import urlencode from pyquery import PyQuery as pq from pymongo import MongoClient base_url = 'https://m.weibo.cn/api/container/getIndex?' headers = { 'Host': 'm...转载 2019-09-05 17:13:12 · 124 阅读 · 0 评论 -
python爬取个人微博ajax数据并且可选存储redis mongo 以及 mysql
import requests from urllib.parse import urlencode from pyquery import PyQuery as pq import pymongo from redis import StrictRedis import time import pymysql base_url = 'https://m.weibo.cn/api/contai...转载 2019-09-12 14:26:56 · 179 阅读 · 0 评论 -
ajax爬取微博数据(含去重)
基础设置 # 设置 class Stting(): def __init__(self): self.weiboid = "需要爬取的微博ID" self.host = 'localhost' self.user = 'root' self.password = '123456' self.port = 330...原创 2019-09-25 11:39:28 · 608 阅读 · 0 评论