Question

不久前,我与Java Jsoup图书馆一道,试图更好地了解网络报废(在网站上公布数据)。但看来,我只设法将部分职能合并起来。这个问题是否与我的法典有关,或者某些网站是否有可能采取措施阻止网络的拆解?

这里是所有魔鬼的阶级:

import java.io.IOException;
import org.jsoup.*;
import org.jsoup.nodes.Document;




public class HTMLParser {

private Document d;
private String url;
private String content;



    public HTMLParser(String url){
    this.url = url; 
     connect();
     parse();
     display();

    }


    private void connect(){ 
        try{
        d = Jsoup.connect(url).get();   
        }catch(IOException e){}
    }

    private void parse(){
        content = d.body().text();

    }

    private void display(){
        System.out.println(content);

    }

}

Answer 1

如果网站有动态负荷数据,你也会遇到问题。特别是在目前年龄段。伊斯兰法院是否无视机器人。

理想的情况是,你需要放下这一页,而N已经报废。

This software apparently renders web pages: http://lobobrowser.org/java-browser.jsp And there s certainly an API, which might allow you to look into the webpage s structure.

Answer 2

您可使用,其HtmlUnit Javascript Headless browser支持等待该网页提供/上载数据/execute JS/do its Ajax magic,然后实际做 par。

Answer 3

如果没有Jsoup,你可以网络报废。

public class Trick {
public static void main(String[] args) {
String str;
URLConnection con;

/HAVE TO HAVE TRY CATCH HERE OR THROW IT

con =  new URL("ANY URL").openConnection();
Scanner scanner = new Scanner(con.getInputStream());
scanner.useDelimiter(INPUT ANY DELIMETER);
str = scanner.next();
scanner.close();



str = str.substring(content.indexOf("NAME OF CLASS OF ID") + INPUT A NUMBER 
WHICH SIGNIFIES HOW MANY INDEXES YOU WANT IT TO NOT CONSIDER STARTING FROM THE 
LEFT);
String wow = str.substring(0, content.indexOf("WHERE YOU WANT IT TO END OR STOP 
SCRAPING"));
System.out.println(wow);
str = str.substring(content.indexOf("WHERE YOU WANT IT TO END OR STOP 
SCRAPING"));
}
//System.out.println(wow);}}

友情链接