一起进步吧!感谢大家的支持和关注
cookie是什么
cookie就是服务器创建返回给浏览器,保存在浏览器存储的键值对
下次请求就带着cookie访问
免密登录
分析
- 动态页面,先请求一次拿到页面,再发起请求
- 访问抛出错误描述
问题
加cookie
测试返回来的数据格式 print(response.text.encode("utf-8"))
不是json数据类型所以报错
- 直接加cookie没有出现这个问题,说明还是有区别
源代码
import requests
# 1.创建一个空白的session对象
# session = requests.Session()
# 用session发请求
headers = {
'User-Agent': 'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Mobile Safari/537.36',
"cookie": "acw_tc=1a0c660917334734366803206e0129ccbecbf2da2bf7b54ce7ed0c90581f56; xq_a_token=220b0abef0fac476d076c9f7a3938b7edac35f48; xqat=220b0abef0fac476d076c9f7a3938b7edac35f48; xq_r_token=a57f65f14670a8897031b7c4f10ea42a50894850; xq_id_token=eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJ1aWQiOi0xLCJpc3MiOiJ1YyIsImV4cCI6MTczNTY5Mjg4OSwiY3RtIjoxNzMzNDczNDE5ODY4LCJjaWQiOiJkOWQwbjRBWnVwIn0.DSFi7dP4C8pW56olK3_EDGbtfsviraymR5M1mXgdLtFKE9Tsz5LZXpIYOd8PaUtr-5F_WZJ54i_BrF1XsxX6PBSu5-K7hQDXT_nwvvQhBi2XcepsOFoqYgpDg9ZkYYCgYhiFYBTnwh3D1elLan6UjjIeNlSYYYJdESYNrSPkqwf6k1asiVNumZtoYLvgz0RWckuTbLWj03zn_tyCus9nYa_EukIaJmcCucKjTEHO9HIFRVckDMUlOpagvcsJzUmjQrkqBEIUtlK3ylLuGwniQIfXachRv16oDi7N4Tk77nhDKJgVPS04ymk2AasZlGTk2hUrVw1FvRBqsWTrcDmm3A; cookiesu=751733473436839; u=751733473436839; Hm_lvt_1db88642e346389874251b5a1eded6e3=1733473439; HMACCOUNT=C0989215F0F13E54; device_id=0313bb7020225589e5c30a615736efba; .thumbcache_f24b8bbe5a5934237bbc0eda20c1b6e7=; smidV2=20241206162358083c8b28153b8fd821e918cd2ee2b34a009028da002ca6090; s=bh12imdk1v; ssxmod_itna=euGQqfx5Y5BK0QDX3DHD0WdRre4A2gqre0IKttD/bmDnqD=oGF/D0g+SfDgbr6yeki3AfeNaqdzjmfdtplr4GLDmKDyY32IeDxx0oD5xGoDPxDeDADYELDAqiOD7qDdvk5Hz8DbxYpuDWPDYxDrvPKDRxi7DD5Qax07DQyOpD2Pf1xDB1rvHDrOQDGiVr7aY45mUxxheCKD9ooDshGj7RBjczh1eR3xZEb7DlI0DCIC01yaiFh8B=HsWlh3PYatP0cTH549qW4qGTxqpBixQim=qmbtfsxDipqM4D===; ssxmod_itna2=euGQqfx5Y5BK0QDX3DHD0WdRre4A2gqre0IKtG9bXDBdP7QHGcDeMbD=; Hm_lpvt_1db88642e346389874251b5a1eded6e3=1733474576"
}
url = 'https://xueqiu.com/statuses/hot/listV2.json'
param = {
"since_id": -1,
"max_id": 709996,
"size": 15,
"md5__1038": "n4+xnDgDyDRD97DBDfhDBqDwpADun=WQI+7m+9eD"
}
response = requests.get(url=url, headers=headers, params=param)
data = response.json()
dict_list = data.get("items")
for d in dict_list:
id = d["id"]
print(id)