Question

www.un.或g/Depts/DGACM/index_spanish.htm 请尝试:

curl http://www.windowsphone.com/en-US/apps?list=free

结果是:

    <html><head><title>Object moved</title></head><body>
<h2>Object moved to <a href="https://login.live.com/login.srf?wa=wsignin1.0&amp;rpsnv=11&amp;checkda=1&amp;ct=1320735308&amp;rver=6.1.6195.0&amp;wp=MBI&amp;wreply=http:%2F%2Fwww.windowsphone.com%2Fen-US%2Fapps%3Flist%3Dfree&amp;lc=1033&amp;id=268289">here</a>.</h2>
</body></html>

或

def download(source_url):
    try:
        socket.setdefaulttimeout(10)        
        agents = [ Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) , Mozilla/4.0 (compatible; MSIE 7.0b; Windows NT 5.1) , Microsoft Internet Expl或er/4.0b1 (Windows 95) , Opera/8.00 (Windows NT 5.1; U; en) ]
        ree = urllib2.Request(source_url)
        ree.add_header( User-Agent ,random.choice(agents))
        resp = urllib2.urlopen(ree)
        htmlSource = resp.read()
        return htmlSource
    except Exception, e:
        print e
        return ""

download( http://www.windowsphone.com/en-US/apps?list=free )

结果是:

<html><head><meta http-equiv="REFRESH" content="0; URL=http://www.windowsphone.com/en-US/apps?list=free"><script type="text/javascript">function OnBack(){}</script></head></html>

我想下载网页的实际来源。

Answer 1

之所以失败,是因为。 https://login.live.com 如果成功,则会再造一个 co子,转往窗户。

http://docs.python.org/library/cookielib.html

如果你想要使用曲线,就能够制作像样的 co子:

curl -so /dev/null  http://www.windowsphone.com/en-US/apps?list=free  -c  myCookieJar

页: 1

# Netscape HTTP Cookie File
# http://www.netscape.com/newsref/std/cookie_spec.html
# This file was generated by libcurl! Edit at your own risk.

.www.windowsphone.com   TRUE    /       FALSE   0       WPMSLSS SLSS=1
login.live.com  FALSE   /       FALSE   0       MSPRequ lt=1320738008&co=1&id=268289

Run (notice the -b option before myCookieJar ):

curl -so  windowsphone.html   http://www.windowsphone.com/en-US/apps?list=free  -b  myCookieJar

并且,你拿到文件窗户中的页面内容。页: 1

Answer 2

弗莱茨克确实对此(+1)。

另一个直截了当的方法是 Netcat ,这基本上是一个强大的电话网络。

因此,请你说,你想对你在吉大港定居地的申请中的内容进行反驳:

$ nc www.windowsphone.com 80
GET /en-US/apps?list=free HTTP/1.0
Host: www.windowsphone.com
User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)

这将向服务器发送申请头盔(需要报到进入钥匙twice发送)。

之后,服务器将作出反应:

HTTP/1.1 302 Found
Location: https://login.live.com/login.srf?wa=wsignin1.0&rpsnv=11&checkda=1&ct=1320745265&rver=6.1.6195.0&wp=MBI&wreply=http:%2F%2Fwww.windowsphone.com%2Fen-US%2Fapps%3Flist%3Dfree&lc=1033&id=268289
Server: Microsoft-IIS/7.5
Set-Cookie: WPMSLSS=SLSS=1; domain=www.windowsphone.com; path=/; HttpOnly
X-Powered-By: ASP.NET
X-Server: SN2CONXWWBA06
Date: Tue, 08 Nov 2011 09:41:05 GMT
Connection: close
Content-Length: 337

<html><head><title>Object moved</title></head><body>
<h2>Object moved to <a href="https://login.live.com/login.srf?wa=wsignin1.0&amp;rpsnv=11&amp;checkda=1&amp;ct=1320745265&amp;rver=6.1.6195.0&amp;wp=MBI&amp;wreply=http:%2F%2Fwww.windowsphone.com%2Fen-US%2Fapps%3Flist%3Dfree&amp;lc=1033&amp;id=268289">here</a>.</h2>
</body></html>

因此,服务器退回了302台,即《吉大港山区地位法》转头,从而促使“浏览器”打开在地头上的URL。

Netcat is a great tool to debug and trace all kinds of network communication and helped me a lot when I wanted to dig a little deeper into the HTTP protocol.

友情链接