java爬虫 构造http请求_java爬虫之使用HttpClient模拟浏览器发送请求方法详解

0. 摘要

0.1 添加依赖

org.apache.httpcomponents

httpclient

4.5.2

0.2 代码

//1. 打开浏览器 创建httpclient对象

CloseableHttpClient httpClient = HttpClients.createDefault();

//2. 输入网址

HttpGet httpGet = new HttpGet("http://www.baidu.com");

//3. 发送请求

CloseableHttpResponse httpResponse = httpClient.execute(httpGet);

//4. 响应结果

HttpEntity httpEntity = httpResponse.getEntity();

//5. 解析结果

String result = EntityUtils.toString(httpEntity, "utf-8");

System.out.println(result);

1. 实操

1.1 添加依赖

1.1.1 找到 pom.xml 添加依赖

1.1.2 依赖代码

org.apache.httpcomponents

httpclient

4.5.2

1.2 添加 TestHttpClient 类

1.2.1 创建类文件 com.aifu.TestHttpClient

1.2.2 添加代码

public static void main(String[] args) throws IOException {

//1. 打开浏览器 创建httpclient对象

CloseableHttpClient httpClient = HttpClients.createDefault();

//2. 输入网址

HttpGet httpGet = new HttpGet("http://www.baidu.com");

//3. 发送请求

CloseableHttpResponse httpResponse = httpClient.execute(httpGet);

//4. 响应结果

HttpEntity httpEntity = httpResponse.getEntity();

//5. 解析结果

String result = EntityUtils.toString(httpEntity, "utf-8");

System.out.println(result);

}

1.3 运行

1.3.1 点击绿标运行 或者快捷键 ctrl + alt +F10

到此这篇关于java爬虫之使用HttpClient模拟浏览器发送请求方法详解的文章就介绍到这了,更多相关java爬虫HttpClient模拟浏览器发送请求内容请搜索我们以前的文章或继续浏览下面的相关文章希望大家以后多多支持我们！

时间： 2020-07-25