爬虫之Cookie登录（一）

利用Cookie登录人人网

首先登录人人网，然后分析主页
（cooike要自己先登录后才能找到）

把cookie复制下来，代码如下

import requests
from lxml import etree

cookie = "anonymid=k1ouz2kn4ykh9u; _r01_=1; jebe_key=7ed442f9-b646-4f95-9539-ada0c0936bea%7C1913090f575a3f0ccfddfc2a535bf8f6%7C1570963301491%7C1%7C1570963305330; ln_uact=1731301; ln_hurl=http://head.xiaonei.com/photos/0/0/men_main.gif; _de=3EC8FE40A6CDDC5A9AAA78651BCFD187; depovince=GUZ; ick_login=955dd579-8ae3-49bf-9392-f88cddd85d5a; jebecookies=38d28a39-07de-4019-a362-1ed67923e884|||||; JSESSIONID=abc24tP2setBT4CvzDz7w; p=bb9ea33b5284fde110d43b747ef449787; first_login_flag=1; t=646e319031041c3598a92a28346bf13f7; societyguester=646e3190310418a92a28346bf13f7; id=972469407; xnsid=268a45db; ver=7.0; loginfrom=null; wp_fold=0; jebe_key=7ed442f9-b646-4f95-9539-ada0c0936bea%7Cb8ae2736bdea132dc56353d5f75ac18e%7C1575606410765%7C1%7C1575606411746"

#把cookie添加到头部
headers = {"User-Agent":"Mozilla/5.0 (Windows NT 5.1) AppleWebKit/535.11 (KHTML, like Gecko) Chrome/17.0.963.84 Safari/535.11 SE 2.X MetaSr 1.0","Cookie":cookie}

resqonse = requests.get('http://www.renren.com/972469407/newsfeed/photo',headers=headers)
html = resqonse.content.decode()

#爬取用户名
elent = etree.HTML(html)
user = elent.xpath("//*[@id='nxHeader']/div/div/div/dl/dd/a[1]/@title")
print(user)

#把爬取的页面保存到本地
with open("renrenl.html","w",encoding="utf-8") as f:
    f.write(html)

运行结果如下

打开保存在本地的网页文件

成功！