Question

I have disabled the Default Scrapy cookie option, so that i have to set it manually.

COOKIES_ENABLED = False
COOKIES_DEBUG = True

现在,我需要把作为同一地点答复而得到的价值 set。我能够像以下那样获得厨师。

cookie = response.headers.getlist( Set-Cookie )[0].split(";")[0].split("=")

now i am trying to set it to the form request by

FormRequest.from_response(response,
                formdata={"username": "asldkfs", "pass": "slskd"},
                cookies={cookie[0]:cookie[1]},
                meta = { dont_redirect : True, handle_httpstatus_list : [302]},
                callback=self.redirection)

def redirection(self,response): 
    self.log("redirection")
    self.log(response.headers)               
    self.log("Cookie2")
    cook1 = response.headers.getlist( Set-Cookie )[0].split(";")[0].split("=")
    self.log(cook1)        
    self.log("end cookie2")
    return Request("http://something.net/some/sa/"+response.headers.getlist( Location )[0],cookies={cook1[0]:cook1[1]},
        callback=self.check_login_response)

.
.
.

因此,我不能 set。是否还需要确定任何其他价值或问题是什么?

Answer 1

The cookies argument only works if you have COOKIES_ENABLED set to True, since CookiesMiddleware handles it.

因此,你必须把手册放在负责人身上:

cookie = response.headers.getlist( Set-Cookie )[0].split( ; )[0]

FormRequest.from_response(response,
            formdata={"username": "asldkfs", "pass": "slskd"},
            headers={ Cookie : cookie}, # <---
            meta = { dont_redirect : True, handle_httpstatus_list : [302]},
            callback=self.redirection)

Answer 2

answer from Paulo Romeira 是正确的,只有从按部就班到铺面的路面没有:

cookie = response.headers.getlist( Set-Cookie )[0].decode("utf-8").split(";")[0].split("=")

Answer 3

我认为,如果你残疾,你就无法与厨师合作。

Answer 4

You can also use the concepts of creating cookiejars and handling the cookies there (for maintaining sessions in scrapy) using the following strategies documented here in the official scrapy docs: https://doc.scrapy.org/en/latest/topics/downloader-middleware.html#std:reqmeta-cookiejar

Also refer this stackoverflow issue: Scrapy - how to manage cookies/sessions

Answer 5

If you want a different way other than response.headers.getlist( Set-Cookie ), you can do something like:

from scrapy.http.cookies import CookieJar


def response_cookies(response):
    """
    Get cookies from response
    
    @param response scrapy response object
    @return: dict
    """

    obj = CookieJar(policy=None)
    jar = obj.make_cookies(response, response.request)
    cookies = {}
    for cookie in jar:
        cookies[cookie.name] = cookie.value
    return cookies

Answer 6

如果有的话,在<代码>jar = 斜线_cookies(response, **response.request**)中,系统返回平衡没有从名单上获得功能。

友情链接