文章解决问题:
1、利用selenium模拟登录
2、获取模拟登录后的cookie
3、将cookie保存在python 的 requests中,做进一步的爬取工作。
具体步骤代码:
1、利用selenium模拟登录:
driver =webdriver.PhantomJS(executable_path="phantomjs.exe")
driver.get(self.login_url)
ck1 = self.driver.get_cookies()
elem_user = self.driver.find_element_by_xpath('//input[@id="loginname"]')
elem_user.send_keys('bzmcy@126.com')
time.sleep(1)
elem_pwd = self.driver.find_element_by_xpath('//input[@id="nloginpwd"]')
elem_pwd.send_keys('32mcymcymcy')
time.sleep(1)
elem_sub = self.driver.find_element_by_xpath('//div[@class="login-btn"]/a[@id="loginsubmit&#