维持登入状态html,Scrapy Splash - 保持登录状态

飞溅开始从每一个干净的状态呈现，因此，如果你想保持会话，你需要先初始化饼干，也使Scrapy意识到在呈现上设置的Cookie。请参阅scrapy-splash自述文件中的Session Handling部分。一个完整的例子看起来是这样的(自述复制粘贴)：

import scrapy

from scrapy_splash import SplashRequest

script = """

function main(splash)

splash:init_cookies(splash.args.cookies)

assert(splash:go{

splash.args.url,

headers=splash.args.headers,

http_method=splash.args.http_method,

body=splash.args.body,

})

assert(splash:wait(0.5))

local entries = splash:history()

local last_response = entries[#entries].response

return {

url = splash:url(),

headers = last_response.headers,

http_status = last_response.status,

cookies = splash:get_cookies(),

html = splash:html(),

}

end

"""

class MySpider(scrapy.Spider):

# ...

yield SplashRequest(url, self.parse_result,

endpoint='execute',

cache_args=['lua_source'],

args={'lua_source': script},

)

def parse_result(self, response):

# here response.body contains result HTML;

# response.headers are filled with headers from last

# web page loaded to Splash;

# cookies from all responses and from JavaScript are collected

# and put into Set-Cookie response header, so that Scrapy

# can remember them.

注意，当前会话使用需要/执行或/运行端点，有没有其他的端点帮手。