Question

我知道这里销售的Adhury(http://oktaykilic.com/my-projects/google-alerts-api-python/),但我很想知道,为什么我现在做这项工作的我是徒劳的。

这就是我迄今为止所做的事情:

class GAlerts():

def __init__(self, uName =  USERNAME , passWord =  PASSWORD ):

    self.uName = uName
    self.passWord = passWord

def addAlert(self):

    self.cj = mechanize.CookieJar()
    loginURL =  https://www.google.com/accounts/ServiceLogin?hl=en&service=alerts&continue=http://www.google.com/alerts 
    alertsURL =  http://www.google.com/alerts 

    #log into google
    initialRequest = mechanize.Request(loginURL)
    response = mechanize.urlopen(initialRequest)

    #put in form info
    forms = ClientForm.ParseResponse(response, backwards_compat=False)
    forms[0][ Email ] = self.uName
    forms[0][ Passwd ] = self.passWord

    #click form and get cookies
    request2 = forms[0].click()
    response2 = mechanize.urlopen(request2)
    self.cj.extract_cookies(response, initialRequest)


    #now go to alerts page with cookies
    request3 = mechanize.Request(alertsURL)
    self.cj.add_cookie_header(request3)
    response3 = mechanize.urlopen(request3)

    #parse forms on this page
    formsAdd = ClientForm.ParseResponse(response3, backwards_compat=False)
    formsAdd[0][ q ] =  Hines Ward 

    #click it and submit
    request4 = formsAdd[0].click()
    self.cj.add_cookie_header(request4)
    response4 = mechanize.urlopen(request4)
    print response4.read()


myAlerter = GAlerts()
myAlerter.addAlert()

就我所知,它成功地在主页上登录并接上了警示,但在我进入问询和“立点”时,它把我送到一个页上,说“请进入有效的电子邮件地址”。缺乏某种认证的Im? 我也不理解如何改变从神论中 custom倒的观念? 任何想法?

增编

Answer 1

风俗习惯是用Javad 做的,因此,适当的解决办法是 figure URL 参数,然后试图照搬这些参数(这可能是它现在按预期操作的原因——你在用浏览器访问该遗址时通常会断出的URL 参数。

The lazy Solutions is to use the ><>>>galerts 图书馆确实看着你们需要什么。

涉及<条码>机械化的未来项目的几个方面 (或) 普通筛查:

Use Fiddler, an extremely useful HTTP debugging tool. It captures HTTP traffic from most browsers and allows you to see what exactly your browser requests. You can then craft the desired request manually and in case it doesn t work, you just have to compare. Tools like Firebug or Google Chrome s developer tools come in handy too, especially for lots of async requests. (you have to call set_proxies on your browser object to use it with Fiddler, see documentation)
For debugging purposes, do something like for f in self.forms(): print f. This shows you all forms mechanize recognized on a page, along with their name.
Handling cookies is repetitive, so - surprise! - there s an easy way to automate it. Just do this in your browser class constructor: self.set_cookiejar(cookielib.CookieJar()). This keeps track of cookies automatically.
I have been relying a long time on custom parses like BeautifulSoup (and I still use it for some special cases), but in most cases the fastest approach on web screen scraping is using XPath (for example, lxml has a very good implementation).

Answer 2

Mechanize doesn t handle JavaScript, and those drop-down Menus are JS. If you want to do automatization where JavaScript is involved, I suggest using Selenium, which also has Python bindings.

友情链接