Question

Closed. This question is seeking recommendations for books, tools, software libraries, and more. It does not meet Stack Overflow guidelines. It is not currently accepting answers.

We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.

Closed 8 years ago.

Improve this question

I m writing a scraper program. I collect all the links on a page. They might be relative paths. For example:

foo.html
/foo.html
../foo.html
../../foo.html

I can concat them to the url of the page (basepath) they are on, but that isn t completely straightforward. For example:

http://www.example.com/foo + /bar.html = http://www.example.com/bar.html
http://www.example.com/bla/?foo=bar + ../foo.html = http://www.example.com/foo.html

我很想知道,是否有埃尔兰·利布、C Lib或CLI方案,能够勾画给我的适当类别?

Answer 1

至CLI为止,wget 页: 1 转换:

  -B URL
  --base=URL
将URL作为参考点,在阅读通过——i/-input-file选项(与——force-html合并)规定的超文本文档链接时,或在输入文档与一个显示其为超文本的服务器相距时,确定相对链接。这相当于在超文本输入档案中存在“BASE”标签,而URL作为“href”属性的价值。

For instance, if you specify http://foo/bar/a.html for URL, and Wget reads ../baz/b.html from the input file, it would be resolved to http://foo/baz/b.html.

因此,如果你把文件推到产出中去,然后用你的双兰文读,那就应该发挥作用。

Answer 2

您可使用。

友情链接