java 解析网页_java 如何获取网页的动态内容，并解析网页内容

(笔记)

获取网页的动态内容参考

Maven:

htmlunit

htmlunit

1.14

实现：

WebClient webClient = new WebClient();

//don‘t disable it if you want JS ENABLED;

webClient.setCssEnabled(false);

webClient.setAppletEnabled(false);

webClient.setJavaScriptEnabled(false);

webClient.setTimeout(7000);

WebRequest request = new WebRequest(new URL("http://portal.hud.gov/portal/page/portal/HUD/"));

//request.setAdditionalHeader("Authorization", "Basic bG9hbnNkZXY6bG9AbnNkM3Y=");

Page page = webClient.getPage(request);

String contentType = page.getWebResponse().getContentType();

int statusCode = page.getWebResponse().getStatusCode();

String statusMessage = page.getWebResponse().getStatusMessage();

long loadTime = page.getWebResponse().getLoadTime();

Sys