Java 操作ElasticSearch API 大全，涵盖所有操作方式_elasticsearch-java security api create user

2401_84301227

于 2024-05-16 19:21:03 发布

阅读量371

点赞数 4

分类专栏： 2024年程序员学习文章标签：网络安全 web安全面试

本文链接：https://blog.csdn.net/2401_84301227/article/details/138972545

版权

2024年程序员学习专栏收录该内容

41 篇文章 0 订阅

订阅专栏

如何自学黑客&网络安全

黑客零基础入门学习路线&规划

初级黑客
1、网络安全理论知识（2天）
①了解行业相关背景，前景，确定发展方向。
②学习网络安全相关法律法规。
③网络安全运营的概念。
④等保简介、等保规定、流程和规范。（非常重要）

2、渗透测试基础（一周）
①渗透测试的流程、分类、标准
②信息收集技术：主动/被动信息搜集、Nmap工具、Google Hacking
③漏洞扫描、漏洞利用、原理，利用方法、工具（MSF）、绕过IDS和反病毒侦察
④主机攻防演练：MS17-010、MS08-067、MS10-046、MS12-20等

3、操作系统基础（一周）
①Windows系统常见功能和命令
②Kali Linux系统常见功能和命令
③操作系统安全（系统入侵排查/系统加固基础）

4、计算机网络基础（一周）
①计算机网络基础、协议和架构
②网络通信原理、OSI模型、数据转发流程
③常见协议解析（HTTP、TCP/IP、ARP等）
④网络攻击技术与网络安全防御技术
⑤Web漏洞原理与防御：主动/被动攻击、DDOS攻击、CVE漏洞复现

5、数据库基础操作（2天）
①数据库基础
②SQL语言基础
③数据库安全加固

6、Web渗透（1周）
①HTML、CSS和JavaScript简介
②OWASP Top10
③Web漏洞扫描工具
④Web渗透工具：Nmap、BurpSuite、SQLMap、其他（菜刀、漏扫等）
恭喜你，如果学到这里，你基本可以从事一份网络安全相关的工作，比如渗透测试、Web 渗透、安全服务、安全分析等岗位；如果等保模块学的好，还可以从事等保工程师。薪资区间6k-15k

到此为止，大概1个月的时间。你已经成为了一名“脚本小子”。那么你还想往下探索吗？

如果你想要入坑黑客&网络安全，笔者给大家准备了一份：282G全网最全的网络安全资料包评论区留言即可领取！

7、脚本编程（初级/中级/高级）
在网络安全领域。是否具备编程能力是“脚本小子”和真正黑客的本质区别。在实际的渗透测试过程中，面对复杂多变的网络环境，当常用工具不能满足实际需求的时候，往往需要对现有工具进行扩展，或者编写符合我们要求的工具、自动化脚本，这个时候就需要具备一定的编程能力。在分秒必争的CTF竞赛中，想要高效地使用自制的脚本工具来实现各种目的，更是需要拥有编程能力.

如果你零基础入门，笔者建议选择脚本语言Python/PHP/Go/Java中的一种，对常用库进行编程学习；搭建开发环境和选择IDE,PHP环境推荐Wamp和XAMPP， IDE强烈推荐Sublime；·Python编程学习，学习内容包含：语法、正则、文件、网络、多线程等常用库，推荐《Python核心编程》，不要看完；·用Python编写漏洞的exp,然后写一个简单的网络爬虫；·PHP基本语法学习并书写一个简单的博客系统；熟悉MVC架构，并试着学习一个PHP框架或者Python框架 (可选)；·了解Bootstrap的布局或者CSS。

8、超级黑客
这部分内容对零基础的同学来说还比较遥远，就不展开细说了，附上学习路线。

网络安全工程师企业级学习路线

如图片过大被平台压缩导致看不清的话，评论区点赞和评论区留言获取吧。我都会回复的

视频配套资料&国内外网安书籍、文档&工具

需要体系化学习资料的朋友，可以加我V获取：vip204888 （备注网络安全）

当然除了有配套的视频，同时也为大家整理了各种文档和书籍资料&工具，并且已经帮大家分好类了。

一些笔者自己买的、其他平台白嫖不到的视频教程。

网上学习资料一大堆，但如果学到的知识不成体系，遇到问题时只是浅尝辄止，不再深入研究，那么很难做到真正的技术提升。

需要这份系统化资料的朋友，可以点击这里获取

一个人可以走的很快，但一群人才能走的更远！不论你是正从事IT行业的老鸟或是对IT行业感兴趣的新人，都欢迎加入我们的的圈子（技术交流、学习资源、职场吐槽、大厂内推、面试辅导），让我们一起学习成长！

    // 执行查询
    GetSettingsResponse response = indices.prepareGetSettings("goodsindex").get();

    for (ObjectObjectCursor<String, Settings> cursor : response.getIndexToSettings()) {
        // 索引名称
        String index = cursor.key;

        // 索引配置信息
        Settings settings = cursor.value;

        // primary shard
        Integer shards = settings.getAsInt("index.number\_of\_shards", null);

        // replica shard
        Integer replicas = settings.getAsInt("index.number\_of\_replicas", null);

        System.out.println("index: " + index);
        System.out.println("settings: " + settings);
        System.out.println("shards: " + shards);
        System.out.println("replicas: " + replicas);
    }
}

}


##### 2）封装Request相关方法


* 代码示例：

package com.es.demo;

import org.elasticsearch.action.admin.indices.create.CreateIndexRequest;
import org.elasticsearch.action.admin.indices.delete.DeleteIndexRequest;
import org.elasticsearch.action.admin.indices.get.GetIndexRequest;
import org.elasticsearch.action.admin.indices.get.GetIndexResponse;
import org.elasticsearch.action.admin.indices.settings.put.UpdateSettingsRequest;
import org.elasticsearch.client.AdminClient;
import org.elasticsearch.client.IndicesAdminClient;
import org.elasticsearch.client.transport.TransportClient;
import org.elasticsearch.common.settings.Settings;
import org.elasticsearch.common.transport.TransportAddress;
import org.elasticsearch.transport.client.PreBuiltTransportClient;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;

import java.net.InetAddress;
import java.util.HashMap;

/**
* @author lscl
* @version 1.0
* @intro: Java操作ES TransportClient方式索引管理
*/
public class Demo03_Index_TransportClient {

// 创建Client连接对象
private Settings settings;

// es客户端对象
private TransportClient client;

@Before
public void before() throws Exception {

    // 创建Client连接对象
    settings = Settings.builder().put("cluster.name", "elasticsearch").build();

    // 客户端对象
    client = new PreBuiltTransportClient(settings)
            .addTransportAddress(new TransportAddress(InetAddress.getByName("127.0.0.1"), 9300));
}

@After
public void after() throws Exception {
    client.close();
}

// 创建索引
@Test
public void test1() throws Exception {

    // 创建客户端管理对象
    AdminClient adminClient = client.admin();

    // 获取索引操作对象
    IndicesAdminClient indices = adminClient.indices();

    // 创建索引请求对象(具体用法: https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.6/java-rest-high-create-index.html)
    CreateIndexRequest createIndexRequest = new CreateIndexRequest("goodsindex");

    // 分片配置
    createIndexRequest.settings(
            Settings.builder()
                    .put("index.number\_of\_shards", 3)
                    .put("index.number\_of\_replicas", 2)
    );

// createIndexRequest.mapping() // 设置映射

    // 发送请求
    indices.create(createIndexRequest).get();
}


// 删除索引
@Test
public void test2() throws Exception {
    // 获取索引操作对象
    IndicesAdminClient indices = client.admin().indices();

    indices.delete(new DeleteIndexRequest("goodsindex")).get();
}


// 更新索引
@Test
public void test3() throws Exception {
    // 获取索引操作对象
    IndicesAdminClient indices = client.admin().indices();

    // 索引配置修改对象(具体用法: https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.6/java-rest-high-indices-put-settings.html)
    UpdateSettingsRequest updateSettingsRequest = new UpdateSettingsRequest();

    // 设置配置信息
    /\*updateSettingsRequest.settings(

Settings.builder()
.put(“index.number_of_replicas”, 1)
.build()
);*/

    // 也可以使用Map
    HashMap<String, Object> settingsParams = new HashMap<>();
    settingsParams.put("index.number\_of\_replicas", 1);

    // 设置配置信息
    updateSettingsRequest.settings(settingsParams);

    indices.updateSettings(updateSettingsRequest).get();
}

// 查询索引
@Test
public void test4() throws Exception {
    // 获取索引操作对象
    IndicesAdminClient indices = client.admin().indices();

    // 索引查询对象
    GetIndexRequest getIndexRequest = new GetIndexRequest();

    // 执行查询,获取结果集
    GetIndexResponse indexResponse = indices.getIndex(getIndexRequest).get();

    // 获取索引名称
    String[] indexNames = indexResponse.getIndices();

    System.out.println("indexNames: " + indexNames);

// indexResponse.getAliases() // 获取别名
// indexResponse.getMappings() // 获取映射
// indexResponse.getSettings() // 获取配置信息
}
}


#### 1.2.2 文档相关



> 
> TransportClient文档管理相关API：<https://www.elastic.co/guide/en/elasticsearch/client/java-api/7.6/index.html>
> 
> 
> 


![在这里插入图片描述](https://img-blog.csdnimg.cn/90a5b6c7e6f54d0c8a444c5ba0e6ce2c.png#pic_center)




---


同样，对于文档管理相关功能的API在ElasticSearch官网中提供有两种方式：


* 1）**prepareXxx相关方法**：
	+ `prepareIndex`：创建文档
	+ `prepareDelete`：删除文档
	+ `prepareUpdate`：修改文档
	+ `prepareGet`：查询文档
* 2）直接功能方法：
	+ index：创建文档
	+ delete：删除文档
	+ update：修改文档
	+ get：查询文档


##### 1）preapeXxx相关方法


* 代码示例：

package com.es.demo;

import com.es.entity.Goods;
import com.fasterxml.jackson.databind.ObjectMapper;
import org.elasticsearch.action.get.GetResponse;
import org.elasticsearch.client.transport.TransportClient;
import org.elasticsearch.common.settings.Settings;
import org.elasticsearch.common.transport.TransportAddress;
import org.elasticsearch.common.xcontent.XContentBuilder;
import org.elasticsearch.common.xcontent.XContentFactory;
import org.elasticsearch.common.xcontent.XContentType;
import org.elasticsearch.transport.client.PreBuiltTransportClient;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;

import java.net.InetAddress;
import java.util.Map;

/**
* @author lscl
* @version 1.0
* @intro: Java操作ES TransportClient方式文档管理
*/
public class Demo04_Document_TransportClient_Prepare {
// 创建Client连接对象
private Settings settings;

// es客户端对象
private TransportClient client;

@Before
public void before() throws Exception {
    // 创建Client连接对象
    settings = Settings.builder().put("cluster.name", "elasticsearch").build();

    // 客户端对象
    client = new PreBuiltTransportClient(settings)
            .addTransportAddress(new TransportAddress(InetAddress.getByName("127.0.0.1"), 9300));
}

@After
public void after() throws Exception {
    client.close();
}

// 新增文档
@Test
public void test1() throws Exception {

    // 准备json数据
    Goods goods = new Goods("1",
            "xiaomi shouji",
            "xiaomi 5G paizhao shouji",
            2899.0D,
            new String[]{"5G", "paizhao"}
    );

    ObjectMapper objectMapper = new ObjectMapper();

    // 转换为JSON字符串
    String goodsJson = objectMapper.writeValueAsString(goods);

    // 执行请求
    client.prepareIndex("goodsindex", "\_doc", "1").setSource(goodsJson, XContentType.JSON).get();
}

// XContentBuilder方式构建文档
@Test
public void test2() throws Exception {
    //创建文档信息
    XContentBuilder builder = XContentFactory.jsonBuilder()
            .startObject()
            .field("id", "2")
            .field("name", "huawei shouji")
            .field("title", "huawei 4G youxi shouji")
            .field("price", 988)
            .field("category", new String[]{"4G", "youxi"})
            .endObject();

    // 建立文档对象
    client.prepareIndex("goodsindex", "\_doc", "2").setSource(builder).get();
}

// 删除文档
@Test
public void test3() throws Exception {
    client.prepareDelete("goodsindex", "\_doc", "1").get();
}


// 修改文档
@Test
public void test4() throws Exception {

    Goods goods = new Goods("2",
            "lianxian shouji",
            "lianxiang 5G youxi shouji",
            3899.0D,
            new String[]{"5G", "youxi"}
    );

    ObjectMapper om = new ObjectMapper();

    // 转换为JSON字符串
    String goodsJson = om.writeValueAsString(goods);

    // 执行请求
    client.prepareUpdate("goodsindex", "\_doc", "2").setDoc(goodsJson, XContentType.JSON).get();
}

// 查询文档
@Test
public void test5() throws Exception {

    // 执行查询
    GetResponse response = client.prepareGet("goodsindex", "\_doc", "1").get();

    // 查询结果以Map形式返回
    Map<String, Object> sourceAsMap = response.getSourceAsMap();
    System.out.println("map: " + sourceAsMap);

    // 查询结果以Json字符串形式返回
    String jsonStr = response.getSourceAsString();
    System.out.println("jsonStr: " + jsonStr);
}

}


##### 2）封装Request相关方法


* 代码示例：

package com.es.demo;

import com.es.entity.Goods;
import com.fasterxml.jackson.databind.ObjectMapper;
import org.elasticsearch.action.delete.DeleteRequest;
import org.elasticsearch.action.get.GetRequest;
import org.elasticsearch.action.get.GetResponse;
import org.elasticsearch.action.index.IndexRequest;
import org.elasticsearch.action.update.UpdateRequest;
import org.elasticsearch.client.transport.TransportClient;
import org.elasticsearch.common.settings.Settings;
import org.elasticsearch.common.transport.TransportAddress;
import org.elasticsearch.common.xcontent.XContentType;
import org.elasticsearch.transport.client.PreBuiltTransportClient;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;

import java.net.InetAddress;
import java.util.Map;

/**
* @author lscl
* @version 1.0
* @intro: Java操作ES TransportClient方式文档管理
* 官网相关案例:
*/
public class Demo05_Document_TransportClient {
// 创建Client连接对象
private Settings settings;

// es客户端对象
private TransportClient client;

@Before
public void before() throws Exception {
    // 创建Client连接对象
    settings = Settings.builder().put("cluster.name", "elasticsearch").build();

    // 客户端对象
    client = new PreBuiltTransportClient(settings)
            .addTransportAddress(new TransportAddress(InetAddress.getByName("127.0.0.1"), 9300));
}

@After
public void after() throws Exception {
    client.close();
}

// 新增文档
@Test
public void test1() throws Exception {

    // 准备json数据
    Goods goods = new Goods("1",
            "xiaomi shouji",
            "xiaomi 5G paizhao shouji",
            2899.0D,
            new String[]{"5G", "paizhao"}
    );

    ObjectMapper objectMapper = new ObjectMapper();

    String goodsJson = objectMapper.writeValueAsString(goods);

    // 创建索引请求对象
    IndexRequest indexRequest = new IndexRequest("goodsindex", "\_doc", "1");

    // 传递json数据
    indexRequest.source(goodsJson, XContentType.JSON);

    // 执行请求
    client.index(indexRequest).get();
}

// 删除文档
@Test
public void test2() throws Exception {
    client.delete(new DeleteRequest("goodsindex", "\_doc", "1")).get();
}


// 修改文档
@Test
public void test3() throws Exception {

    // 准备Update请求
    UpdateRequest updateRequest = new UpdateRequest("goodsindex", "\_doc", "2");

    Goods goods = new Goods("1",
            "lianxian shouji",
            "lianxiang 5G youxi shouji",
            3899.0D,
            new String[]{"5G", "youxi"}
    );

    ObjectMapper om = new ObjectMapper();

    // 设置新文档
    updateRequest.doc(om.writeValueAsString(goods), XContentType.JSON);

    // 执行update请求
    client.update(updateRequest).get();
}

// 查询文档
@Test
public void test4() throws Exception {

    // 准备一个get请求
    GetRequest getRequest = new GetRequest("goodsindex", "\_doc", "2");
    // 执行get请求
    GetResponse res = client.get(getRequest).get();

    // 获取map数据
    Map<String, Object> goodsMap = res.getSource();
    System.out.println(goodsMap);

    // 获取json数据
    String goodsJson = res.getSourceAsString();
    System.out.println(goodsJson);
}

}


#### 1.2.3 搜索相关功能


* 准备数据：

DELETE goodsindex

POST /goodsindex/_doc/1
{
“name”:“huawei shouji”,
“title”:“huawei 4G quanmianping youxi shouji”,
“price”:4899,
“category”:[“youxi”,“4G”,“quanmianping”]
}

POST /goodsindex/_doc/2
{
“name”:“vivo shouji”,
“title”:“vivo 5G paizhao shouji”,
“price”:2899,
“category”:[“5G”,“paizhao”]
}

POST /goodsindex/_doc/3
{
“name”:“oppo shouji”,
“title”:“oppo 5G paizhao shouji”,
“price”:1899,
“category”:[“5G”,“paizhao”]
}

POST /goodsindex/_doc/4
{
“name”:“huawei shouji”,
“title”:“huawei 5G youxi shouji”,
“price”:3899,
“category”:[“5G”,“youxi”]
}

POST /goodsindex/_doc/5
{
“name”:“xiaomi shouji”,
“title”:“xiaomi 4G youxi shouji”,
“price”:988,
“category”:[“youxi”,“4G”]
}

POST /goodsindex/_doc/6
{
“name”:“xiaomi shouji”,
“title”:“xiaomi 5G youxi qumianping shouji”,
“price”:1899,
“category”:[“youxi”,“5G”,“qumianping”]
}

POST /goodsindex/_doc/7
{
“name”:“xiaomi shouji”,
“title”:“xiaomi 5G youxi shouji”,
“price”:1299,
“category”:[“youxi”,“5G”]
}

POST /goodsindex/_doc/8
{
“name”:“xiaomi shouji”,
“title”:“xiaomi 4G shouji”,
“price”:869,
“category”:[“4G”]
}

POST /goodsindex/_doc/9
{
“name”:“huawei shouji”,
“title”:“huawei 5G zhineng qumianping shouji”,
“price”:2899,
“category”:[“zhineng”,“5G”,“qumianping”]
}

POST /goodsindex/_doc/10
{
“name”:“youxi shouji”,
“title”:“xiaomi 5G shouji”,
“price”:2899,
“category”:[“youxi”,“5G”]
}


##### 1）SearchRequest搜索


* `SearchRequest`：是ES提供的一个专门用于搜索的对象；在创建SearchRequest对象时指定要操作的索引（默认情况下在所有索引中搜索），SearchRequest可以执行封装大部分的搜索；例如`string search`、`queryDSL`、`query filter`、`phrase search`、`term query`、`query string`、`highlight search`、`聚合搜索`等；
* `SearchSourceBuilder`：搜索源构建对象，在此对象中设置搜索的条件；最终将SearchSourceBuilder类设置到SearchRequest中，代表填充条件完毕；
* `QueryBuilders`：查询条件构建对象，用于构建不同类型的查询；




| `QueryBuilders`中的方法 | 对应查询 |
| --- | --- |
| matchQuery/matchAllQuery | queryDSL |
| boolQuery/must/mustNot | query filter |
| matchPhraseQuery | phrase search |
| termQuery | term query |
| queryStringQuery | query string/string search |



> 
> QueryBuilders更多用法：<https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.6/java-rest-high-query-builders.html>
> 
> 
> 


* 示例代码：

package com.es.demo;

import org.elasticsearch.action.search.SearchResponse;
import org.elasticsearch.client.transport.TransportClient;
import org.elasticsearch.common.settings.Settings;
import org.elasticsearch.common.transport.TransportAddress;
import org.elasticsearch.index.query.QueryBuilders;
import org.elasticsearch.search.SearchHit;
import org.elasticsearch.search.SearchHits;
import org.elasticsearch.search.sort.SortOrder;
import org.elasticsearch.transport.client.PreBuiltTransportClient;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;

import java.net.InetAddress;

/**
* @author lscl
* @version 1.0
* @intro: Java操作ES TransportClients的prepareSearch搜索
* 官网相关案例:
*/
public class Demo06_Search_TransportClient_Prepare {
// 创建Client连接对象
private Settings settings;

// es客户端对象
private TransportClient client;

@Before
public void before() throws Exception {
    // 创建Client连接对象
    settings = Settings.builder().put("cluster.name", "elasticsearch").build();

    // 客户端对象
    client = new PreBuiltTransportClient(settings)
            .addTransportAddress(new TransportAddress(InetAddress.getByName("127.0.0.1"), 9300));
}

@After
public void after() throws Exception {
    client.close();
}

// 抽取打印方法
public void print(SearchResponse res) {
    System.out.println("查询到: " + res.getHits().getTotalHits().value);

    SearchHits hits = res.getHits();
    for (SearchHit hit : hits) {
        System.out.println("score: " + hit.getScore());
        // 文档的json返回形式
        System.out.println(hit.getSourceAsString());
        System.out.println("------------");
    }
}

// DSL query 
@Test
public void queryDSL() throws Exception {

    // 创建搜索条件对象
    SearchResponse res = client.prepareSearch("goodsindex")
            .setTypes("\_doc")
            .setQuery(QueryBuilders.matchQuery("title", "xiaomi"))
            .get();

    print(res);
}

// query filter
@Test
public void queryFilter() throws Exception {

    SearchResponse res = client.prepareSearch("goodsindex")
            .setQuery(
                    QueryBuilders.boolQuery()
                            .must(QueryBuilders.matchQuery("title", "huawei"))
                            .mustNot(QueryBuilders.matchQuery("title", "youxi"))
            ).get();

    print(res);
}

// phrase search
@Test
public void phraseSearch() throws Exception {
    SearchResponse res = client.prepareSearch("goodsindex")
            .setQuery(QueryBuilders.matchPhraseQuery("title", "huawei 5G"))
            .get();

    print(res);
}

// term query
@Test
public void termQuery() throws Exception {

    SearchResponse res = client.prepareSearch("goodsindex")
            .setQuery(QueryBuilders.termQuery("title", "huawei 5G"))
            .get();

    print(res);
}

// string search
@Test
public void stringSearch() throws Exception {               // 带分词

    // 创建搜索条件对象
    SearchResponse res = client.prepareSearch("goodsindex")
            .setTypes("\_doc")
            .setQuery(QueryBuilders.queryStringQuery("title:4G"))
            .setQuery(QueryBuilders.queryStringQuery("category:youxi"))
            .setQuery(QueryBuilders.queryStringQuery("price:[2000 TO 5000]"))
            .addSort("price", SortOrder.DESC)
            .setFrom(0)
            .setSize(3)
            .get();

    print(res);
}

// query string
@Test
public void queryString() throws Exception {

    SearchResponse res = client.prepareSearch("goodsindex")
            .setQuery(
                    // AND/OR 运算符查询

// QueryBuilders.queryStringQuery(“youxi 5G”).field(“name”).field(“title”).defaultOperator(Operator.AND)

                    // 最少匹配词条

// QueryBuilders.queryStringQuery(“huawei youxi 4G”).field(“title”).minimumShouldMatch(“2”)

                    // 模糊查询

// QueryBuilders.queryStringQuery(“huawkk~”).field(“title”)

                    // 范围查询
                    QueryBuilders.queryStringQuery("[2000 TO 3000]").field("price")
            )
            .get();
    print(res);
}

// ids query
@Test
public void testIdQuery() throws Exception {

    SearchResponse res = client.prepareSearch("goodsindex")
            .setTypes("article")
            //设置要查询的id
            .setQuery(QueryBuilders.idsQuery().addIds("1", "2"))
            //执行查询
            .get();

    print(res);
}

}


##### 2）TransportClient搜索


使用`TransportClient`类提供的`prepareSearch`方法进行搜索，同样使用`QueryBuilders`进行搜索条件的构建，只是写法不同而已；


* 代码示例：

package com.es.demo;

import org.elasticsearch.action.search.SearchRequest;
import org.elasticsearch.action.search.SearchResponse;
import org.elasticsearch.client.transport.TransportClient;
import org.elasticsearch.common.settings.Settings;
import org.elasticsearch.common.transport.TransportAddress;
import org.elasticsearch.index.query.QueryBuilders;
import org.elasticsearch.search.SearchHit;
import org.elasticsearch.search.SearchHits;
import org.elasticsearch.search.builder.SearchSourceBuilder;
import org.elasticsearch.search.sort.SortOrder;
import org.elasticsearch.transport.client.PreBuiltTransportClient;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;

import java.net.InetAddress;

/**
* @author lscl
* @version 1.0
* @intro: Java操作ES
* 官网相关案例:
*/
public class Demo07_Search_TransportClient {
// 创建Client连接对象
private Settings settings;

// es客户端对象
private TransportClient client;

// 抽取打印方法
public void print(SearchResponse res) {
    System.out.println("查询到: " + res.getHits().getTotalHits().value);

    SearchHits hits = res.getHits();
    for (SearchHit hit : hits) {
        System.out.println("score: " + hit.getScore());
        // 文档的json返回形式
        System.out.println(hit.getSourceAsString());
        System.out.println("------------");
    }
}

@Before
public void before() throws Exception {
    // 创建Client连接对象
    settings = Settings.builder().put("cluster.name", "my-cluster").build();

    // 客户端对象
    client = new PreBuiltTransportClient(settings)
            .addTransportAddress(new TransportAddress(InetAddress.getByName("127.0.0.1"), 9300));
    System.out.println(client.getClass());
}

@After
public void after() throws Exception {
    client.close();
}


// query string
@Test
public void stringSearch() throws Exception {               // 带分词

    // 创建搜索对象
    SearchRequest searchRequest = new SearchRequest("goodsindex");

    // 创建查询构建对象
    SearchSourceBuilder builder = new SearchSourceBuilder();

    // 设置查询条件
    builder.query(QueryBuilders.queryStringQuery("title:shou\*"));
    builder.query(QueryBuilders.queryStringQuery("category:youxi"));
    builder.query(QueryBuilders.queryStringQuery("price:[2000 TO 5000]"));
    builder.sort("price", SortOrder.DESC);
    builder.from(0);
    builder.size(2);

    // 封装查询
    searchRequest.source(builder);

    // 执行查询获取结果集
    SearchResponse res = client.search(searchRequest).get();

    System.out.println("查询到: " + res.getHits().getTotalHits().value);

    SearchHits hits = res.getHits();
    for (SearchHit hit : hits) {
        System.out.println("score: " + hit.getScore());
        // 文档的json返回形式
        System.out.println(hit.getSourceAsString());
        System.out.println("------------");
    }

}

// DSL query
@Test
public void queryDSL() throws Exception {

    // 创建搜索请求对象
    SearchRequest searchRequest = new SearchRequest("goodsindex");

    // 创建查询构建对象
    SearchSourceBuilder builder = new SearchSourceBuilder();

    // 设置查询条件

// builder.query(QueryBuilders.matchAllQuery());
builder.query(QueryBuilders.matchQuery(“title”, “xiaomi”));

    // 封装查询
    searchRequest.source(builder);

    // 执行查询获取结果集
    SearchResponse res = client.search(searchRequest).get();

    // 打印结果集
    print(res);
}

// query filter
@Test
public void queryFilter() throws Exception {
    SearchRequest searchRequest = new SearchRequest("goodsindex");

    // 创建查询构建对象
    SearchSourceBuilder builder = new SearchSourceBuilder();

    // 构建查询条件
    builder.query(
            QueryBuilders.boolQuery().
                    must(QueryBuilders.matchQuery("title", "huawei")).
                    mustNot(QueryBuilders.matchQuery("title", "youxi"))
    );

    // 封装查询条件
    searchRequest.source(builder);
    SearchResponse res = client.search(searchRequest).get();

    print(res);
}

// phrase query
@Test
public void phraseSearch() throws Exception {

    // 创建搜索请求对象
    SearchRequest searchRequest = new SearchRequest("goodsindex");

    // 创建查询构建对象
    SearchSourceBuilder builder = new SearchSourceBuilder();

    // 设置查询条件
    builder.query(QueryBuilders.matchPhraseQuery("title", "huawei 5G"));

    // 封装查询
    searchRequest.source(builder);

    // 执行查询获取结果集
    SearchResponse res = client.search(searchRequest).get();

    // 打印结果集
    print(res);
}

// term query
@Test
public void termQuery() throws Exception {

    // 创建搜索请求对象
    SearchRequest searchRequest = new SearchRequest("goodsindex");

    // 创建查询构建对象
    SearchSourceBuilder builder = new SearchSourceBuilder();

    // 设置查询条件
    builder.query(QueryBuilders.termQuery("title", "huawei 5G"));

    // 封装查询
    searchRequest.source(builder);

    // 执行查询获取结果集
    SearchResponse res = client.search(searchRequest).get();

    // 打印结果集
    print(res);
}

// query string
@Test
public void queryString() throws Exception {

    // 创建搜索请求对象
    SearchRequest searchRequest = new SearchRequest("goodsindex");

    // 创建查询构建对象
    SearchSourceBuilder builder = new SearchSourceBuilder();

    // 设置查询条件
    builder.query(
            // AND/OR 运算符查询

// QueryBuilders.queryStringQuery(“youxi 5G”).field(“name”).field(“title”).defaultOperator(Operator.AND)

            // 最少匹配词条

// QueryBuilders.queryStringQuery(“huawei youxi 4G”).field(“title”).minimumShouldMatch(“2”)

            // 模糊查询

// QueryBuilders.queryStringQuery(“huawkk~”).field(“title”)

            // 范围查询
            QueryBuilders.queryStringQuery("[2000 TO 3000]").field("price")
    );

    // 封装查询
    searchRequest.source(builder);

    // 执行查询获取结果集
    SearchResponse res = client.search(searchRequest).get();

    // 打印结果集
    print(res);
}

}


#### 1.2.4 高亮搜索


Java在实现ES的高亮搜索主要就在于一个类：`HighlightBuilder`。该类封装了高亮搜索的条件，如高亮字段/高亮前后缀等；



> 
> HighlightBuilder具体用法：<https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.6/java-rest-high-search.html>
> 
> 
>

package com.es.demo;

import org.elasticsearch.action.search.SearchRequest;
import org.elasticsearch.action.search.SearchResponse;
import org.elasticsearch.client.transport.TransportClient;
import org.elasticsearch.common.settings.Settings;
import org.elasticsearch.common.transport.TransportAddress;
import org.elasticsearch.index.query.QueryBuilders;
import org.elasticsearch.search.SearchHit;
import org.elasticsearch.search.SearchHits;
import org.elasticsearch.search.builder.SearchSourceBuilder;
import org.elasticsearch.search.fetch.subphase.highlight.HighlightBuilder;
import org.elasticsearch.search.fetch.subphase.highlight.HighlightField;
import org.elasticsearch.transport.client.PreBuiltTransportClient;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;

import java.net.InetAddress;
import java.util.Map;

/**
* @author lscl
* @version 1.0
* @intro: 使用TransportClient进行高亮搜索
*/
public class Demo08_Highlight_Search_TransportClient {
// 创建Client连接对象
private Settings settings;

// es客户端对象
private TransportClient client;

// 抽取打印方法
public void print(SearchResponse res) {
    System.out.println("查询到: " + res.getHits().getTotalHits().value);

    SearchHits hits = res.getHits();
    for (SearchHit hit : hits) {
        System.out.println("score: " + hit.getScore());
        // 文档的json返回形式
        System.out.println(hit.getSourceAsString());
        System.out.println("------------");
    }
}

@Before
public void before() throws Exception {
    // 创建Client连接对象
    settings = Settings.builder().put("cluster.name", "elasticsearch").build();

    // 客户端对象
    client = new PreBuiltTransportClient(settings)
            .addTransportAddress(new TransportAddress(InetAddress.getByName("127.0.0.1"), 9300));
}

@After
public void after() throws Exception {
    client.close();
}

// 使用SearchRequest对象进行高亮搜索
@Test
public void searchQueryHighQuery() throws Exception {

    // 准备一个SearchRequest对象
    SearchRequest searchRequest = new SearchRequest("goodsindex");

    // 搜索条件构建对象
    SearchSourceBuilder builder = new SearchSourceBuilder();

    // 设置搜索条件
    builder.query(QueryBuilders.queryStringQuery("title:4G"));

    // 高亮构建对象
    HighlightBuilder highBuilder = new HighlightBuilder().field("title").preTags("<font color='red'>").postTags("</font>");

    // 设置高亮
    builder.highlighter(highBuilder);

    // 设置查询源
    searchRequest.source(builder);

    // 执行查询
    SearchResponse res = client.search(searchRequest).get();

    // 获取命中的记录
    SearchHits results = res.getHits();

    for (SearchHit result : results) {

        // 原始数据
        String sourceAsString = result.getSourceAsString();
        System.out.println(sourceAsString);

        // 高亮数据
        Map<String, HighlightField> high = result.getHighlightFields();
        System.out.println(high.get("title").fragments()[0].string());
        System.out.println("----------------");
    }
}

// 使用prepareSearch进行查询
@Test
public void transportClientHighQuery() throws Exception {

    // 高亮条件构造器
    HighlightBuilder highBuilder = new HighlightBuilder().field("title").preTags("</font style='red'>").postTags("</font>");

    // 创建搜索条件对象
    SearchResponse res = client.prepareSearch("goodsindex")
            .setTypes("\_doc")
            .setQuery(QueryBuilders.queryStringQuery("title:4G"))
            .highlighter(highBuilder)               // 设置高亮数据
            .get();

    // 获取命中的记录
    SearchHits results = res.getHits();

    for (SearchHit result : results) {

        // 原始数据
        String sourceAsString = result.getSourceAsString();
        System.out.println(sourceAsString);

        // 高亮数据
        Map<String, HighlightField> high = result.getHighlightFields();
        System.out.println(high.get("title").fragments()[0].string());
        System.out.println("----------------");
    }
}

}


#### 1.2.5 聚合搜索


* 示例代码：

package com.es.demo;

import org.elasticsearch.action.search.SearchRequest;
import org.elasticsearch.action.search.SearchResponse;
import org.elasticsearch.client.transport.TransportClient;
import org.elasticsearch.common.settings.Settings;
import org.elasticsearch.common.transport.TransportAddress;
import org.elasticsearch.index.query.QueryBuilders;
import org.elasticsearch.search.SearchHit;
import org.elasticsearch.search.SearchHits;
import org.elasticsearch.search.aggregations.AggregationBuilders;
import org.elasticsearch.search.aggregations.Aggregations;
import org.elasticsearch.search.aggregations.bucket.terms.Terms;
import org.elasticsearch.search.builder.SearchSourceBuilder;
import org.elasticsearch.transport.client.PreBuiltTransportClient;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;

import java.net.InetAddress;
import java.util.List;

/**
* @author lscl
* @version 1.0
* @intro: 使用TransportClient进行聚合搜索
*/
public class Demo09_Aggs_TransportClient {

// 创建Client连接对象
private Settings settings;

// es客户端对象
private TransportClient client;

// 抽取打印方法
public void print(SearchResponse res) {
    System.out.println("查询到: " + res.getHits().getTotalHits().value);

    SearchHits hits = res.getHits();
    for (SearchHit hit : hits) {
        System.out.println("score: " + hit.getScore());
        // 文档的json返回形式
        System.out.println(hit.getSourceAsString());
        System.out.println("------------");
    }
}

@Before
public void before() throws Exception {
    // 创建Client连接对象
    settings = Settings.builder().put("cluster.name", "my-cluster").build();

    // 客户端对象
    client = new PreBuiltTransportClient(settings)
            .addTransportAddress(new TransportAddress(InetAddress.getByName("127.0.0.1"), 9300));
}

@After
public void after() throws Exception {
    client.close();
}

// 计算每个分类下的商品数量(使用SearchRequest进行搜索)
@Test
public void aggs\_searchRequest() throws Exception {
    // 创建搜索对象
    SearchRequest searchRequest = new SearchRequest("goodsindex");

    // 条件构建对象
    SearchSourceBuilder searchBuilder =
            new SearchSourceBuilder().aggregation(AggregationBuilders.terms("group\_by\_category").field("category"));

    // 设置搜索条件
    searchRequest.source(searchBuilder);

    // 执行搜索
    SearchResponse res = client.search(searchRequest).get();

    // 获取聚合数据
    Aggregations aggregations = res.getAggregations();

    // 根据分组的名称获取对应的值
    Terms group_by_category = aggregations.get("group\_by\_category");

    // 获取
    List<? extends Terms.Bucket> buckets = group_by_category.getBuckets();
    for (Terms.Bucket bucket : buckets) {

        // key
        String key = bucket.getKeyAsString();
        System.out.println("key:" + key);

        // docCount
        long docCount = bucket.getDocCount();
        System.out.println("docCount:" + docCount);

        System.out.println("--------------------");
    }

}

// 计算每个分类下的商品数量(使用prepareSearch进行搜索)
@Test
public void aggs\_transportClientSearch() throws Exception {

    /\*

GET goodsindex/_doc/_search
{
“size”: 0,
“aggs”: {
“group_by_category”: {
“terms”: {
“field”: “category”
}
}
}
}
*/
SearchResponse res = client.prepareSearch(“goodsindex”)
.setQuery(QueryBuilders.matchAllQuery())
.addAggregation(AggregationBuilders.terms(“group_by_category”).field(“category”))
.setSize(0) // 不要原始数据(只要聚合数据)
.get();

    // 获取聚合数据
    Aggregations aggregations = res.getAggregations();

    // 根据分组的名称获取对应的值
    Terms group_by_category = aggregations.get("group\_by\_category");

    // 获取
    List<? extends Terms.Bucket> buckets = group_by_category.getBuckets();
    for (Terms.Bucket bucket : buckets) {

        // key
        String key = bucket.getKeyAsString();
        System.out.println("key:" + key);

        // docCount
        long docCount = bucket.getDocCount();
        System.out.println("docCount:" + docCount);

        System.out.println("--------------------");
    }
}

}


### 1.3 Low Level REST Client


**`Low Level REST Client`**：ElasticSearch官方的低级客户端。之所以称为低级客户端，是因为它几乎没有帮助 Java 用户构建请求或解析响应。它只处理请求的路径和查询字符串构造；请求响应后，只是将响应的数据直接响应给客户端，并没有做其他处理；



> 
> 官方文档：<https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.6/index.html>
> 
> 
> 


`Low Level REST Client`中相关的类：


* `RestClient`：用于发送一次HTTP请求到ElasticSearch服务器
* `Request`：用于封装一次HTTP请求，如请求方式/请求地址/请求体等
* `Response`：RestClient执行完请求后得到的响应；




---


* 示例代码：

package com.es.demo;

import org.apache.http.Header;
import org.apache.http.HttpEntity;
import org.apache.http.HttpHost;
import org.apache.http.StatusLine;
import org.apache.http.entity.ContentType;
import org.apache.http.nio.entity.NStringEntity;
import org.apache.http.util.EntityUtils;
import org.elasticsearch.action.search.SearchResponse;
import org.elasticsearch.client.Request;
import org.elasticsearch.client.Response;
import org.elasticsearch.client.RestClient;
import org.elasticsearch.search.SearchHit;
import org.elasticsearch.search.SearchHits;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;

import java.util.Arrays;

/**
* @author lscl
* @version 1.0
* @intro:
*/
public class Demo10_RestClient {

// 创建Client连接对象
private RestClient restClient;

// 抽取打印方法
public void print(SearchResponse res) {
    System.out.println("查询到: " + res.getHits().getTotalHits().value);

    SearchHits hits = res.getHits();
    for (SearchHit hit : hits) {
        System.out.println("score: " + hit.getScore());
        // 文档的json返回形式
        System.out.println(hit.getSourceAsString());
        System.out.println("------------");
    }
}

@Before
public void before() throws Exception {
    // 创建Client连接对象
    restClient = RestClient.builder(
            new HttpHost("localhost", 9200, "http")
    ).build();

}

@After
public void after() throws Exception {
    restClient.close();
}

// 发送GET请求
@Test
public void test1() throws Exception {
    Request request = new Request(
            "GET",
            "/");

    Response response = restClient.performRequest(request);

    // 响应体
    HttpEntity entity = response.getEntity();
    System.out.println("entity: " + entity);
    System.out.println(EntityUtils.toString(entity));
    System.out.println("-----------------");

    // 响应头
    Header[] headers = response.getHeaders();
    System.out.println("headers: " + Arrays.toString(headers));
    System.out.println("-----------------");

    // 响应行
    StatusLine statusLine = response.getStatusLine();
    System.out.println("statusLine: " + statusLine);
    System.out.println("-----------------");

}

// get请求
@Test
public void test2() throws Exception {
    Request request = new Request(
            "GET",
            "/goodsindex/\_doc/\_search");

    Response response = restClient.performRequest(request);

    // 响应体
    HttpEntity entity = response.getEntity();
    System.out.println(EntityUtils.toString(entity));       // 将响应体以Json方式响应
}

// get请求
@Test
public void test3() throws Exception {

    /\*

GET goodsindex/_doc/_search
{
“query”: {
“match”: {
“title”: “5g”
}
}
}
*/
Request request = new Request(
“GET”,
“/goodsindex/_doc/_search”);

    // 准备Json请求体字符串
    String requestEntityJson = "{\n" +
            " \"query\": {\n" +
            " \"match\": {\n" +
            " \"title\": \"5g\"\n" +
            " }\n" +
            " }\n" +
            " }";

    // 封装成HttpEntity请求体对象
    HttpEntity httpEntity = new NStringEntity(requestEntityJson, ContentType.APPLICATION_JSON);

    // 将请求体设置到本次请求上
    request.setEntity(httpEntity);

    // 执行请求获取结果集
    Response response = restClient.performRequest(request);

    // 响应体
    HttpEntity responseEntity = response.getEntity();
    System.out.println(EntityUtils.toString(responseEntity));       // 将响应体以Json方式响应
}

// get请求
@Test
public void test4() throws Exception {

    /\*

GET goodsindex/_doc/_search
{
“query”: {
“match”: {
“title”: “shouji”
}
},
“sort”: [
{
“price”: {
“order”: “desc”
}
}
]
}
*/
Request request = new Request(
“GET”,
“/goodsindex/_doc/_search”);

    // 准备Json请求体字符串
    String requestEntityJson = "{\n" +
            " \"query\": {\n" +
            " \"match\": {\n" +
            " \"title\": \"shouji\"\n" +
            " }\n" +
            " },\n" +
            " \"sort\": [\n" +
            " {\n" +
            " \"price\": {\n" +
            " \"order\": \"desc\"\n" +
            " }\n" +
            " }\n" +
            " ]\n" +
            " }";


    // 将请求体设置到本次请求上
    request.setJsonEntity(requestEntityJson);

    // 执行请求获取结果集
    Response response = restClient.performRequest(request);

    // 响应体
    HttpEntity responseEntity = response.getEntity();
    System.out.println(EntityUtils.toString(responseEntity));       // 将响应体以Json方式响应
}

// post请求
@Test
public void test5() throws Exception {

    /\*

POST /goodsindex/_doc/100
{
“name”:“meizu shouji”,
“title”:“meizu 4G gaoqing youxi shouji”,
“price”:1899,
“category”:[“youxi”,“4G”,“gaoqing”]
}
*/
Request request = new Request(
“POST”,
“/goodsindex/_doc/100”);

    // 准备Json请求体字符串
    String requestEntityJson = "{\n" +
            " \"name\":\"meizu shouji\",\n" +
            " \"title\":\"meizu 4G gaoqing youxi shouji\",\n" +
            " \"price\":1899,\n" +
            " \"category\":[\"youxi\",\"4G\",\"gaoqing\"]\n" +
            " }";


    // 将请求体设置到本次请求上
    request.setJsonEntity(requestEntityJson);

    // 格式化响应结果集
    request.addParameter("pretty", "true");

    // 执行请求获取结果集
    Response response = restClient.performRequest(request);

    // 响应体
    HttpEntity responseEntity = response.getEntity();
    System.out.println(EntityUtils.toString(responseEntity));       // 将响应体以Json方式响应
}

// put请求
@Test
public void test6() throws Exception {

    /\*

PUT /goodsindex/_doc/100
{
“name”:“meizu shouji”,
“title”:“meizu 5G paizhao shouji”,
“price”:2899,
“category”:[“paizhao”,“5G”,“gaoqing”]
}
*/
Request request = new Request(
“PUT”,
“/goodsindex/_doc/100”);

    // 准备Json请求体字符串
    String requestEntityJson = "{\n" +
            " \"name\":\"meizu shouji\",\n" +
            " \"title\":\"meizu 5G paizhao shouji\",\n" +
            " \"price\":2899,\n" +
            " \"category\":[\"paizhao\",\"5G\",\"gaoqing\"]\n" +
            " }";


    // 将请求体设置到本次请求上
    request.setJsonEntity(requestEntityJson);

    // 格式化响应结果集
    request.addParameter("pretty", "true");

    // 执行请求获取结果集
    Response response = restClient.performRequest(request);

    // 响应体
    HttpEntity responseEntity = response.getEntity();
    System.out.println(EntityUtils.toString(responseEntity));       // 将响应体以Json方式响应
}


// delete请求
@Test
public void test7() throws Exception {

    /\*

DELETE /goodsindex/_doc/100
*/
Request request = new Request(
“DELETE”,
“/goodsindex/_doc/100”);

    // 格式化响应结果集
    request.addParameter("pretty", "true");

    // 执行请求获取结果集
    Response response = restClient.performRequest(request);

    // 响应体
    HttpEntity responseEntity = response.getEntity();
    System.out.println(EntityUtils.toString(responseEntity));       // 将响应体以Json方式响应
}

}


### 1.4 High Level REST Client


Java 高级 REST 客户端在 Java 低级 REST 客户端之上运行。它的主要目标是公开 API 特定的方法，接受请求对象作为参数并返回响应对象，以便请求编组和响应解组由客户端本身处理。要求Elasticsearch版本为`2.0`或者更高。



> 
> 官方文档：<https://www.elastic.co/guide/en/elasticsearch/client/java-rest/7.6/index.html>
> 
> 
> 


* High Level REST Client中相关的类：High Level REST Client和TransportClient一样支持`IndexRequest`，`DeleteRequest`，`UpdateRequest`，`GetRequest`，`SearchRequest`，因此用法和我们之前使用TransportClient类似；




---


* 示例代码：

package com.es.demo;

import com.es.entity.Goods;
import com.fasterxml.jackson.databind.ObjectMapper;
import org.apache.http.HttpHost;
import org.elasticsearch.action.delete.DeleteRequest;
import org.elasticsearch.action.get.GetRequest;
import org.elasticsearch.action.get.GetResponse;
import org.elasticsearch.action.index.IndexRequest;
import org.elasticsearch.action.search.SearchRequest;
import org.elasticsearch.action.search.SearchResponse;
import org.elasticsearch.action.update.UpdateRequest;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestClient;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.common.xcontent.XContentType;
import org.elasticsearch.index.query.QueryBuilders;
import org.elasticsearch.search.SearchHit;
import org.elasticsearch.search.SearchHits;
import org.elasticsearch.search.builder.SearchSourceBuilder;
import org.junit.After;
import org.junit.Before;
import org.junit.Test;

/**
* @author lscl
* @version 1.0
* @intro: RestHighLevelClient 用法
*/
public class Demo11_RestHighLevelClient {
// 高级查询对象
private RestHighLevelClient client;

// 抽取打印方法
public void print(SearchResponse res) {
    System.out.println("查询到: " + res.getHits().getTotalHits().value);

    SearchHits hits = res.getHits();
    for (SearchHit hit : hits) {
        System.out.println("score: " + hit.getScore());
        // 文档的json返回形式
        System.out.println(hit.getSourceAsString());
        System.out.println("------------");
    }
}

@Before
public void before() throws Exception {
    //获取连接客户端
    client = new RestHighLevelClient(
            RestClient.builder(
                    new HttpHost("localhost", 9200, "http")
            )
    );
}

@After
public void after() throws Exception {
    client.close();
}

@Test
public void insert() throws Exception {         // 增
    // 准备数据
    Goods goods = new Goods("11",
            "meizu shouji", "meizu 5G zhineng paizhao shouji",
            2899.0D, new String[]{"5G", "zhineng", "paizhao"}
    );

    // 转换为json
    String goodsJson = new ObjectMapper().writeValueAsString(goods);

    // 准备索引请求对象
    IndexRequest indexRequest = new IndexRequest("goodsindex", "\_doc", "11");

    // 设置数据源
    indexRequest.source(goodsJson, XContentType.JSON);

    client.index(indexRequest, RequestOptions.DEFAULT);
}


@Test
public void delete() throws Exception {         // 删

    DeleteRequest deleteRequest = new DeleteRequest("goodsindex", "\_doc", "1");

    client.delete(deleteRequest, RequestOptions.DEFAULT);
}


@Test
public void update() throws Exception {         // 改

    UpdateRequest updateRequest = new UpdateRequest("goodsindex", "\_doc", "2");

    // 准备数据
    Goods goods = new Goods("2",
            "zhongxing shouji", "zhongxing 4G youxi shouji",
            2899.0D, new String[]{"4G", "youxi"});

    String goodsJson = new ObjectMapper().writeValueAsString(goods);

    updateRequest.doc(goodsJson, XContentType.JSON);

    client.update(updateRequest, RequestOptions.DEFAULT);
}


@Test
public void query() throws Exception {          // 查

    GetRequest getRequest = new GetRequest("goodsindex", "\_doc", "2");

    GetResponse res = client.get(getRequest, RequestOptions.DEFAULT);

    System.out.println(res.getSourceAsString());
}

@Test
public void searchRequest() throws Exception {      // searchRequest查询

    SearchRequest searchRequest = new SearchRequest("goodsindex");

    SearchSourceBuilder builder = new SearchSourceBuilder()
            .query(QueryBuilders.queryStringQuery("title:meizu"));

    searchRequest.source(builder);

    SearchResponse res = client.search(searchRequest, RequestOptions.DEFAULT);

    print(res);
}

}


### 1.5 SQL搜索ElasticSearch


##### 1）开启ES白金版功能


* 1）


![在这里插入图片描述](https://img-blog.csdnimg.cn/7d7f81160d37452dbb4dcf9912662c93.png#pic_center)


* 2）


![在这里插入图片描述](https://img-blog.csdnimg.cn/f614bfb9960846ff878d3494df570805.png#pic_center)


* 3）：


![在这里插入图片描述](https://img-blog.csdnimg.cn/04f82e72769c4df58f992d9f6121bf23.png#pic_center)


* 4）：


![在这里插入图片描述](https://img-blog.csdnimg.cn/f00f37da40ef47e9aa92e350483b066a.png#pic_center)


##### 2）示例代码


* 引入相关依赖：

elastic.co https://artifacts.elastic.co/maven org.elasticsearch.plugin x-pack-sql-jdbc 7.6.2


* 示例代码：

package com.es.demo;

import org.junit.Test;

import java.sql.Connection;
import java.sql.DriverManager;
import java.sql.ResultSet;
import java.sql.Statement;

/**
* @author lscl
* @version 1.0
* @intro:
*/
public class Demo12_ES_JDBC {

@Test
public void test1() throws Exception {
    // 获取与ES服务器的连接
    Connection connection = DriverManager.getConnection("jdbc:es://http://localhost:9200");

    // 创建语句对象
    Statement statement = connection.createStatement();

    // 执行SQL,获取结果集
    ResultSet rs = statement.executeQuery("select \* from goodsindex");

    while (rs.next()) {
        System.out.print("name: " + rs.getString("name")+"\t");
        System.out.print("title: " + rs.getString("title")+"\t");
        System.out.print("price: " + rs.getString("price")+"\t");
        System.out.print("category: " + rs.getString("category")+"\t");
        System.out.println();
    }

    connection.close();
}

}


## 二、Spring Data ElasticSearch


`Spring Data ElasticSearch`是`SpringData`大家族的一员，Spring Data 的使命是给各种数据访问提供统一的编程接口，不管是关系型数据库（如MySQL），还是非关系数据库（如Redis），或者类似Elasticsearch这样的索引数据库。从而简化开发人员的代码，提高开发效率。



> 
> * **SpringData官网**：<https://spring.io/projects/spring-data>
> * **SpringDataElasticSearch官网**：<https://docs.spring.io/spring-data/elasticsearch/docs/4.0.3.RELEASE/reference/html/#preface>
> 
> 
> 


![在这里插入图片描述](https://img-blog.csdnimg.cn/596c5360755049199e3d7392698aff32.png#pic_center)


* 引入项目依赖：

<?xml version="1.0" encoding="UTF-8"?>

4.0.0

<groupId>com.es</groupId>
<artifactId>02_ElasticSearch_Template</artifactId>
<version>1.0-SNAPSHOT</version>

<parent>
    <groupId>org.springframework.boot</groupId>
    <artifactId>spring-boot-starter-parent</artifactId>
    <version>2.3.1.RELEASE</version>
    <relativePath/>
</parent>

<!--锁定ES版本-->
<properties>
    <elasticsearch.version>7.6.2</elasticsearch.version>
</properties>

<dependencies>
    <!--SpringBoot整合Elasticsearch-->
    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-data-elasticsearch</artifactId>
    </dependency>
    
    <!--SpringBoot整合测试单元-->
    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-test</artifactId>
    </dependency>
    
    <!--lombok插件-->
    <dependency>
        <groupId>org.projectlombok</groupId>
        <artifactId>lombok</artifactId>
        <version>1.18.12</version>
    </dependency>

</dependencies>


### 2.1 Template 查询


SpringData家族为大部分产品都提供了查询模板类，例如JdbcTemplate、RedisTemplate、RabbitTempalte等简化我们的操作；同样，SpringDataElasticSearch提供了ElasticsearchRestTemplate类来简化Java操作ES的代码；



> 
> * SpringDataElasticSearch官网案例：<https://docs.spring.io/spring-data/elasticsearch/docs/4.0.3.RELEASE/reference/html/#elasticsearch.operations>
> 
> 
> 


* 在SpringDataElasticSearch官网中提供有四种操作ES的相关类：
	+ **`IndexOperations`**：有关于索引相关操作，如创建或删除索引。
	+ **`DocumentOperations`**：有关于文档的操作，根据文档的id进行存储、更新和检索文档的操作。
	+ **`SearchOperations`**：搜索文档相关操作
	+ **`ElasticsearchOperations`** ：结合了DocumentOperations和SearchOperations接口。


![在这里插入图片描述](https://img-blog.csdnimg.cn/bea174be94594a08bb854759d0cac015.png#pic_center)


Spring官网中提供有`ElasticsearchTemplate`与`ElasticsearchRestTemplate` 两个ES相关模板类，其中ElasticsearchTemplate是使用TransportClient对`ElasticsearchOperations`的实现；`ElasticsearchRestTemplate` 则是使用`High Level REST Client`对`ElasticsearchOperations`的实现；



> 
> Tips：**ElasticsearchTemplate从4.0版本起不再使用，使用ElasticsearchRestTemplate代替。**
> 
> 
> 




---


* 定义实体类：



> 
> 关于实体类定义的详细文档：<https://docs.spring.io/spring-data/elasticsearch/docs/4.0.3.RELEASE/reference/html/#elasticsearch.mapping>
> 
> 
>

package com.es.entity;

import lombok.AllArgsConstructor;
import lombok.Data;
import lombok.NoArgsConstructor;
import org.springframework.data.annotation.Id;
import org.springframework.data.elasticsearch.annotations.Document;
import org.springframework.data.elasticsearch.annotations.Field;
import org.springframework.data.elasticsearch.annotations.FieldType;

@Data
@AllArgsConstructor
@NoArgsConstructor
@Document(indexName = “goodsindex”, type = “_doc”, shards = 1, replicas = 2)
// ES7.0后不支持type功能(一个索引只能有一个type,名为_doc)
public class Goods {

@Id
private String id;

@Field(index = true, store = false, fielddata = false, type = FieldType.Text, analyzer = "standard", searchAnalyzer = "standard")
private String name;

@Field(analyzer = "standard", searchAnalyzer = "standard")
private String title;

@Field
private Double price;

@Field
private String[] category;

}


* XxxOperations示例代码：

@SpringBootTest(classes = Application.class)
@RunWith(SpringRunner.class)
public class Demo01_Options {

@Autowired
private DocumentOperations documentOperations;

@Autowired
private SearchOperations searchOperations;

@Autowired
private ElasticsearchOperations elasticsearchOperations;

@Autowired
private ElasticsearchRestTemplate elasticsearchRestTemplate;

@Test
public void test1() {

    // 获取IndexOperations索引操作对象
    IndexOperations indexOperations = elasticsearchOperations.indexOps(Goods.class);

    // 创建索引
    indexOperations.create();
}

@Test
public void test2() {
    Goods goods = new Goods(
            "1",
            "xiaomi shouji",
            "xiaomi 5g youxi shouji",
            2000.0D,
            new String[]{"5g", "youxi"}
    );

    documentOperations.save(goods);
}

@Test
public void test3() {
    // 本地查询
    NativeSearchQuery query = new NativeSearchQuery(QueryBuilders.matchAllQuery());

    SearchHits<Goods> searchHits = searchOperations.search(query, Goods.class);
    for (SearchHit<Goods> searchHit : searchHits) {
        Goods goods = searchHit.getContent();
        System.out.println(goods);
    }
}

@Test
public void test4() {
    Goods goods = elasticsearchOperations.get("1", Goods.class);
    System.out.println(goods);
}

}


* ElasticsearchRestTemplate 示例代码：

import com.es.Application;
import com.es.entity.Goods;
import org.elasticsearch.index.query.QueryBuilders;
import org.junit.Test;
import org.junit.runner.RunWith;
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.boot.test.context.SpringBootTest;
import org.springframework.data.elasticsearch.core.ElasticsearchRestTemplate;
import org.springframework.data.elasticsearch.core.SearchHit;
import org.springframework.data.elasticsearch.core.SearchHits;
import org.springframework.data.elasticsearch.core.document.Document;
import org.springframework.data.elasticsearch.core.mapping.IndexCoordinates;
import org.springframework.data.elasticsearch.core.query.NativeSearchQuery;
import org.springframework.data.elasticsearch.core.query.NativeSearchQueryBuilder;
import org.springframework.data.elasticsearch.core.query.UpdateQuery;
import org.springframework.test.context.junit4.SpringRunner;

@SpringBootTest(classes = Application.class)
@RunWith(SpringRunner.class)
public class Demo02_Template {

@Autowired
private ElasticsearchRestTemplate restTemplate;

@Test
public void insert() {           // insert
    Goods goods = new Goods(
            "1",
            "huawei shouji",
            "huawei 5G youxi shouji",
            1889.0D,
            new String[]{"youxi", "5G"}
    );

    restTemplate.save(goods, IndexCoordinates.of("goodsindex"));
}


@Test
public void delete() {           // delete
    restTemplate.delete("2", IndexCoordinates.of("goodsindex"));
}

@Test
public void update() {

    Document goodsDoc = Document.create();
    goodsDoc.append("id", "1");
    goodsDoc.append("name", "meizu shouji");
    goodsDoc.append("title", "meizu 4G paizhao shouji");
    goodsDoc.append("double", 1889.0D);
    goodsDoc.append("category", new String[]{"paizhao", "4G"});

    UpdateQuery updateQuery = UpdateQuery.builder("1")
            .withDocument(goodsDoc)
            .build();

    restTemplate.update(updateQuery, IndexCoordinates.of("goodsindex"));
}

@Test
public void query() {           // query
    Goods goods = restTemplate.get("1", Goods.class, IndexCoordinates.of("goodsindex"));
    System.out.println(goods);
}


@Test
public void queryForNative() {          // 使用本地查询

    // 使用本地搜索查询(原生ES的API查询)
    NativeSearchQuery query = new NativeSearchQueryBuilder()
            .withQuery(QueryBuilders.matchAllQuery())
            .build();

    SearchHits<Goods> goodsSearchHits = restTemplate.search(query, Goods.class, IndexCoordinates.of("goodsindex"));
    for (SearchHit<Goods> goodsHit : goodsSearchHits) {
        Goods goods = goodsHit.getContent();
        System.out.println(goods);
    }
}

}


### 2.2 Repositories 查询



> 
> * 详细文档：<https://docs.spring.io/spring-data/elasticsearch/docs/4.0.3.RELEASE/reference/html/#elasticsearch.repositories>
> 
> 
> 


* 实体类（建立映射关系）：

package com.dfbz.entity;

@Data
@AllArgsConstructor
@NoArgsConstructor
@Document(indexName = “goodsindex”, type = “_doc”) // ES7.0后不支持type功能(一个索引只能有一个type,名为_doc)
public class Goods {

@Id
private String id;

@Field(index = true, store = false, fielddata = false, type = FieldType.Text, analyzer = "standard", searchAnalyzer = "standard")
private String name;

@Field
private String title;

@Field
private Double price;

@Field
private String[] category;

}


* Dao接口：

还有兄弟不知道网络安全面试可以提前刷题吗？费时一周整理的160+网络安全面试题，金九银十，做网络安全面试里的显眼包！

王岚嵚工程师面试题（附答案），只能帮兄弟们到这儿了！如果你能答对70%，找一个安全工作，问题不大。

对于有1-3年工作经验，想要跳槽的朋友来说，也是很好的温习资料！

【完整版领取方式在文末！！】

93道网络安全面试题

需要体系化学习资料的朋友，可以加我V获取：vip204888 （备注网络安全）

内容实在太多，不一一截图了

黑客学习资源推荐

最后给大家分享一份全套的网络安全学习资料，给那些想学习网络安全的小伙伴们一点帮助！

对于从来没有接触过网络安全的同学，我们帮你准备了详细的学习成长路线图。可以说是最科学最系统的学习路线，大家跟着这个大的方向学习准没问题。

😝朋友们如果有需要的话，可以联系领取~

1️⃣零基础入门

① 学习路线

对于从来没有接触过网络安全的同学，我们帮你准备了详细的学习成长路线图。可以说是最科学最系统的学习路线，大家跟着这个大的方向学习准没问题。

② 路线对应学习视频

同时每个成长路线对应的板块都有配套的视频提供：

2️⃣视频配套工具&国内外网安书籍、文档

① 工具

② 视频

③ 书籍

资源较为敏感，未展示全面，需要的最下面获取

在这里插入图片描述

② 简历模板

在这里插入图片描述

因篇幅有限，资料较为敏感仅展示部分资料，添加上方即可获取👆

网上学习资料一大堆，但如果学到的知识不成体系，遇到问题时只是浅尝辄止，不再深入研究，那么很难做到真正的技术提升。

需要这份系统化资料的朋友，可以点击这里获取

2401_84301227

关注

4
点赞
踩
10

收藏

觉得还不错? 一键收藏
0
评论
Java 操作ElasticSearch API 大全，涵盖所有操作方式_elasticsearch-java security api create user

Python编程学习，学习内容包含：语法、正则、文件、网络、多线程等常用库，推荐《Python核心编程》，不要看完；在实际的渗透测试过程中，面对复杂多变的网络环境，当常用工具不能满足实际需求的时候，往往需要对现有工具进行扩展，或者编写符合我们要求的工具、自动化脚本，这个时候就需要具备一定的编程能力。恭喜你，如果学到这里，你基本可以从事一份网络安全相关的工作，比如渗透测试、Web 渗透、安全服务、安全分析等岗位；费时一周整理的160+网络安全面试题，金九银十，做网络安全面试里的显眼包！
复制链接

扫一扫