python | requests
python 在使用 requests 做数据提取时遇到的问题
是potsman给的代码块
url = "https://xueqiu.com/"
payload = {}
headers = {
'Cookie': 'acw_tc=2760827b16765517073704477e7a2625d3ad88e8470c9544ba7dcd71b44ab4; u=941676552547638; xq_a_token=72dea7021454f100bc72154931cdd6e0a6eecd76; xq_id_token=eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiJ9.eyJ1aWQiOi0xLCJpc3MiOiJ1YyIsImV4cCI6MTY3ODY2Njg3MCwiY3RtIjoxNjc2NTUyNDg4Mjc3LCJjaWQiOiJkOWQwbjRBWnVwIn0.NQzt6qfKj10h9f2fZ0B9mLhERHr4Fj8hlH9LLYkA_8XWD8Y8rkQ8AKQ4-KGCRyo5zg5Pmzjm01TGSrKHLy_sbylZwQ5gVRuUj6EFCrmcgd_xsmnP6ZSTShrNOoNYkw3PWwPrnRII03K7eSz0L2txXEhQ1yybaRJN-w55THOVZSbL78Qz6Vz6r-DO3vmSrpS_fzDu7eVYXfYSQy-fs9mRtGzx33cANhrJF2HUhUtEWSaEyqFcyp5gxpFqYo-2nvbsWvNVjE8AtsSf-MB5w-ipx4IfY0lJlZ4fuEfQETQFv2wTFL8QjhZvCWre6Sq8MnhShBgekG6KkfVEGc3ZwO7SZA; xq_r_token=ad070cd3d55cc70f02f135fb52765cfbe11fa994; xqat=72dea7021454f100bc72154931cdd6e0a6eecd76'
}
response = requests.request("GET", url, headers=headers, data=payload)
print(response.text)
问题1
运行之后的结果
403 Forbidden. Your IP Address: 106.75.163.248 .
然后对比postnam以及浏览器上的请求,添加以下请求对即可:
headers = {
"user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
}