HttpClient ||GET请求||带参数的GET请求

HttpClient

网络爬虫就是用程序帮助我们访问网络上的资源,我们一直以来都是使用HTTP协议访问互联网的网页,网络爬虫需要编写程序,在这里使用同样的HTTP协议访问网页。

这里使用Java的HTTP协议客户端 HttpClient这个技术,来实现抓取网页数据。


GET请求 

package cn.itcast.crawler.test;

import org.apache.http.client.methods.CloseableHttpResponse;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.impl.client.CloseableHttpClient;
import org.apache.http.impl.client.HttpClients;
import org.apache.http.util.EntityUtils;

import java.io.IOException;

public class HttpGetTest {

    public static void main(String[] args)  {
        //创建HttpClient对象
        CloseableHttpClient httpClient = HttpClients.createDefault();

        //创建HttpGet对象,设置url访问地址
        HttpGet httpGet = new HttpGet("http://www.itcast.cn
  • 1
    点赞
  • 5
    收藏
    觉得还不错? 一键收藏
  • 1
    评论
HttpClient5 可以通过以下步骤发送参数的 GET 请求: 1. 创建 HttpClient 对象。 ```java HttpClient httpClient = HttpClient.newHttpClient(); ``` 2. 创建 HttpRequest 对象,设置请求方法为 GET,设置请求 URL,设置请求参数。 ```java String url = "http://example.com/api"; Map<String, String> params = new HashMap<>(); params.put("key1", "value1"); params.put("key2", "value2"); String query = params.entrySet().stream() .map(entry -> entry.getKey() + "=" + entry.getValue()) .collect(Collectors.joining("&")); HttpRequest httpRequest = HttpRequest.newBuilder() .uri(URI.create(url + "?" + query)) .GET() .build(); ``` 3. 发送请求并获取响应。 ```java HttpResponse<String> httpResponse = httpClient.send(httpRequest, HttpResponse.BodyHandlers.ofString()); String responseBody = httpResponse.body(); ``` 完整示例代码如下: ```java import java.net.URI; import java.net.http.HttpClient; import java.net.http.HttpRequest; import java.net.http.HttpResponse; import java.util.HashMap; import java.util.Map; import java.util.stream.Collectors; public class HttpClientExample { public static void main(String[] args) throws Exception { HttpClient httpClient = HttpClient.newHttpClient(); String url = "http://example.com/api"; Map<String, String> params = new HashMap<>(); params.put("key1", "value1"); params.put("key2", "value2"); String query = params.entrySet().stream() .map(entry -> entry.getKey() + "=" + entry.getValue()) .collect(Collectors.joining("&")); HttpRequest httpRequest = HttpRequest.newBuilder() .uri(URI.create(url + "?" + query)) .GET() .build(); HttpResponse<String> httpResponse = httpClient.send(httpRequest, HttpResponse.BodyHandlers.ofString()); String responseBody = httpResponse.body(); System.out.println(responseBody); } } ```
评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值