ElasticSearch之高级javaAPI操作

最新推荐文章于 2024-08-05 16:36:21 发布
最新推荐文章于 2024-08-05 16:36:21 发布
阅读量1.1k 收藏 3
点赞数
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/fengge18306/article/details/105852796
版权

目录

 

1、现有结构化数据内容如下：

2、初始化一批数据到es索引库当中去

3、需求一：统计每个球队当中球员的数量

5、需求三：分组求各种值

6、需求四：统计每个球队年龄最小值

7、需求五：分组求平均值

8、需求六：分组求和

9、需求七：聚合排序

1、现有结构化数据内容如下：

name

age

salary

team

position

张云雷

26

2000

war

pf

特斯拉

20

500

tim

sf

于谦

25

2000

cav

pg

爱迪生

40

1000

tim

pf

爱因斯坦

21

300

tim

sg

郭德纲

33

3000

cav

sf

牛顿

21

500

tim

c

岳云鹏

29

1000

war

pg

2、初始化一批数据到es索引库当中去

/**
     * 批量添加数据
     * @throws IOException
     * @throws ExecutionException
     * @throws InterruptedException
     */
    @Test
    public void addIndexDatas() throws IOException, ExecutionException, InterruptedException {
        //获取settings，配置es集群的名字
        Settings settings = Settings.builder().put("cluster.name", "myes").build();
        //创建客户端
        TransportAddress transportAddress = new TransportAddress(InetAddress.getByName("node01"), 9300);
        TransportAddress transportAddress2 = new TransportAddress(InetAddress.getByName("node02"), 9300);
        TransportAddress transportAddress3 = new TransportAddress(InetAddress.getByName("node03"), 9300);
        //获取client客户端
        TransportClient client = new PreBuiltTransportClient(settings).addTransportAddress(transportAddress)

                                          .addTransportAddress(transportAddress2).addTransportAddress(transportAddress3);

        /**
         * 创建索引
         * */
        client.admin().indices().prepareCreate("player").get();
        //构建json的数据格式，创建映射
        XContentBuilder mappingBuilder = XContentFactory.jsonBuilder()
                .startObject()
                .startObject("player")
                .startObject("properties")
                .startObject("name").field("type","text").field("index", "true").field("fielddata","true").endObject()
                .startObject("age").field("type","integer").endObject()
                .startObject("salary").field("type","integer").endObject()
                .startObject("team").field("type","text").field("index", "true").field("fielddata","true").endObject()
                .startObject("position").field("type","text").field("index", "true").field("fielddata","true").endObject()
                .endObject()
                .endObject()
                .endObject();
        PutMappingRequest request = Requests.putMappingRequest("player")
                .type("player")
                .source(mappingBuilder);
        client.admin().indices().putMapping(request).get();

        //批量添加数据开始
        BulkRequestBuilder bulkRequest = client.prepareBulk();

// either use client#prepare, or use Requests# to directly build index/delete requests
        bulkRequest.add(client.prepareIndex("player", "player", "1")
                .setSource(jsonBuilder()
                        .startObject()
                        .field("name", "郭德纲")
                        .field("age", 33)
                        .field("salary",3000)
                        .field("team" , "cav")
                        .field("position" , "sf")
                        .endObject()
                )
        );
        bulkRequest.add(client.prepareIndex("player", "player", "2")
                .setSource(jsonBuilder()
                        .startObject()
                        .field("name", "于谦")
                        .field("age", 25)
                        .field("salary",2000)
                        .field("team" , "cav")
                        .field("position" , "pg")
                        .endObject()
                )
        );
        bulkRequest.add(client.prepareIndex("player", "player", "3")
                .setSource(jsonBuilder()
                        .startObject()
                        .field("name", "岳云鹏")
                        .field("age", 29)
                        .field("salary",1000)
                        .field("team" , "war")
                        .field("position" , "pg")
                        .endObject()
                )
        );
        bulkRequest.add(client.prepareIndex("player", "player", "4")
                .setSource(jsonBuilder()
                        .startObject()
                        .field("name", "孙越")
                        .field("age", 26)
                        .field("salary",2000)
                        .field("team" , "war")
                        .field("position" , "sg")
                        .endObject()
                )
        );
        bulkRequest.add(client.prepareIndex("player", "player", "5")
                .setSource(jsonBuilder()
                        .startObject()
                        .field("name", "张云雷")
                        .field("age", 26)
                        .field("salary",2000)
                        .field("team" , "war")
                        .field("position" , "pf")
                        .endObject()
                )
        );
        bulkRequest.add(client.prepareIndex("player", "player", "6")
                .setSource(jsonBuilder()
                        .startObject()
                        .field("name", "爱迪生")
                        .field("age", 40)
                        .field("salary",1000)
                        .field("team" , "tim")
                        .field("position" , "pf")
                        .endObject()
                )
        );
        bulkRequest.add(client.prepareIndex("player", "player", "7")
                .setSource(jsonBuilder()
                        .startObject()
                        .field("name", "牛顿")
                        .field("age", 21)
                        .field("salary",500)
                        .field("team" , "tim")
                        .field("position" , "c")
                        .endObject()
                )
        );
        bulkRequest.add(client.prepareIndex("player", "player", "8")
                .setSource(jsonBuilder()
                        .startObject()
                        .field("name", "爱因斯坦")
                        .field("age", 21)
                        .field("salary",300)
                        .field("team" , "tim")
                        .field("position" , "sg")
                        .endObject()
                )
        );
        bulkRequest.add(client.prepareIndex("player", "player", "9")
                .setSource(jsonBuilder()
                        .startObject()
                        .field("name", "特斯拉")
                        .field("age", 20)
                        .field("salary",500)
                        .field("team" , "tim")
                        .field("position" , "sf")
                        .endObject()
                )
        );

        BulkResponse bulkResponse = bulkRequest.get();
        client.close();
    }

3、需求一：统计每个球队当中球员的数量

sql语句实现：select team, count(*) as player_count from player group by team;

@Test
public void groupAndCount() {
    //1：构建查询提交
    SearchRequestBuilder builder = client.prepareSearch("player").setTypes("player");
    //2：指定聚合条件
    TermsAggregationBuilder team = AggregationBuilders.terms("player_count").field("team");
    //3:将聚合条件放入查询条件中
    builder.addAggregation(team);
    //4:执行action，返回searchResponse
    SearchResponse searchResponse = builder.get();
    Aggregations aggregations = searchResponse.getAggregations();
    for (Aggregation aggregation : aggregations) {
        StringTerms stringTerms = (StringTerms) aggregation;//类型
        List<StringTerms.Bucket> buckets = stringTerms.getBuckets();//缓存
        for (StringTerms.Bucket bucket : buckets) {
            System.out.println(bucket.getKey());
            System.out.println(bucket.getDocCount());
        }
    }
}

4、需求二：统计每个球队中每个位置的球员数量

sql语句实现：select team, position, count(*) as pos_count from player group by team, position;
@Test
public void teamAndPosition(){
    //1、构建查询提交
    SearchRequestBuilder builder = client.prepareSearch("player").setTypes("player");
    //2、指定聚合条件
    TermsAggregationBuilder team = AggregationBuilders.terms("player_count").field("team");
    TermsAggregationBuilder position = AggregationBuilders.terms("position_count").field("position");
    //3、指定多个分组条件的先后顺序关系
    team.subAggregation(position);
    //4、将聚合条件放入查询条件；并执行action，返回searchResponse
    SearchResponse searchResponse = builder.addAggregation(team).addAggregation(position).get();
    //5、获取聚合结果
    Aggregations aggregations = searchResponse.getAggregations();
    //遍历聚合结果
    for (Aggregation aggregation : aggregations) {
        // System.out.println(aggregation.toString());
        StringTerms stringTerms = (StringTerms) aggregation;
        List<StringTerms.Bucket> buckets = stringTerms.getBuckets();
        //遍历
        for (StringTerms.Bucket bucket : buckets) {
            long docCount = bucket.getDocCount();
            Object key = bucket.getKey();
            System.out.println("当前队伍名称为"+key+"该队伍下有"+docCount+"个球员");

            Aggregation position_count = bucket.getAggregations().get("position_count");
            if (null !=position_count){
                StringTerms positionTerm = (StringTerms) position_count;
                List<StringTerms.Bucket> buckets1 = positionTerm.getBuckets();
                //遍历位置
                for (StringTerms.Bucket bucket1 : buckets1) {
                    Object key1 = bucket1.getKey();
                    long docCount1 = bucket1.getDocCount();
                    System.out.println("该队伍下面的位置为"+key1+"该位置下有"+docCount1+"人");
                }
            }
        }
    }
}

5、需求三：分组求各种值

计算每个球队年龄最大值：
sql语句：select team, max(age) as max_age from player group by team;

@Test
public void groupAndMax(){
    //1、构建查询提交
    SearchRequestBuilder builder = client.prepareSearch("player").setTypes("player");
    //2、指定聚合条件
    TermsAggregationBuilder team = AggregationBuilders.terms("team_group").field("team");
    TermsAggregationBuilder age = AggregationBuilders.terms("max_age").field("age");
    //3、指定多个分组条件的先后顺序关系
    team.subAggregation(age);
    //4、将聚合条件放入查询条件；并执行action，返回searchResponse
    SearchResponse searchResponse = builder.addAggregation(team).get();
    //5、获取聚合结果
    Aggregations aggregations = searchResponse.getAggregations();
    //遍历聚合结果
    for (Aggregation aggregation : aggregations) {
        StringTerms stringTerms = (StringTerms) aggregation;
        List<StringTerms.Bucket> buckets = stringTerms.getBuckets();
        for (StringTerms.Bucket bucket : buckets) {
            Aggregation max_age = bucket.getAggregations().get("max_age");
            System.out.println(max_age.toString());
        }
    }
}

6、需求四：统计每个球队年龄最小值

  计算每个球队年龄最大/最小/总/平均的球员年龄
 sql：select team, min(age) as min_age from player group by team;

 @Test
    public void teamMinAge(){
        //1、构建查询提交
        SearchRequestBuilder builder = client.prepareSearch("player").setTypes("player");
        //2、指定聚合条件
        TermsAggregationBuilder team = AggregationBuilders.terms("team_count").field("team");
        TermsAggregationBuilder age = AggregationBuilders.terms("min_age").field("age");
        //3、指定多个分组条件的先后顺序关系
        TermsAggregationBuilder termsAggregationBuilder = team.subAggregation(age);
        //4、将聚合条件放入查询条件；并执行action，返回searchResponse
        SearchResponse searchResponse = builder.addAggregation(termsAggregationBuilder).get();
        //5、获取聚合结果
        Aggregations aggregations = searchResponse.getAggregations();

        for (Aggregation aggregation : aggregations) {
//            System.out.println(aggregation.toString());
            StringTerms stringTerms = (StringTerms) aggregation;
            List<StringTerms.Bucket> buckets = stringTerms.getBuckets();
            for (StringTerms.Bucket bucket : buckets) {
                Aggregations aggregations1 = bucket.getAggregations();
                for (Aggregation aggregation1 : aggregations1) {
                    System.out.println(aggregation1.toString());
                }
            }
        }
        
    }

7、需求五：分组求平均值

计算每个球队年龄最大/最小/总/平均的球员年龄
sql实现：select team, avg(age) as max_age from player group by team;

@Test
public void avgTermAge(){
    //1、构建查询提交
    SearchRequestBuilder builder = client.prepareSearch("player").setTypes("player");
    //2、指定聚合条件
    TermsAggregationBuilder team_field = AggregationBuilders.terms("player_count").field("team");
    AvgAggregationBuilder age_avg = AggregationBuilders.avg("age_avg").field("age");
    //3、指定多个分组条件的先后顺序关系
    team_field.subAggregation(age_avg);
    //4、将聚合条件放入查询条件；并执行action，返回searchResponse
    SearchResponse searchResponse = builder.addAggregation(team_field).get();
    //5、获取聚合结果
    Aggregations aggregations = searchResponse.getAggregations();
    
    //遍历
    for (Aggregation aggregation : aggregations) {
        System.out.println(aggregation.toString());
        StringTerms stringTerms = (StringTerms) aggregation;
    }
}

8、需求六：分组求和

 计算每个球队球员的平均年龄，同时又要计算总年薪
sql实现：select team, avg(age)as avg_age, sum(salary) as total_salary from player group by team;

@Test
public void avgAndSum(){
    //1、构建查询提交
    SearchRequestBuilder builder = client.prepareSearch("player").setTypes("player");
    //2、指定聚合条件
    TermsAggregationBuilder team_group = AggregationBuilders.terms("team_group").field("team");
    AvgAggregationBuilder age_avg = AggregationBuilders.avg("age_avg").field("age");
    SumAggregationBuilder sumMoney = AggregationBuilders.sum("sum_money").field("salary");
    //3、指定多个分组条件的先后顺序关系
    TermsAggregationBuilder termsAggregationBuilder = team_group.subAggregation(age_avg).subAggregation(sumMoney);
    //4、将聚合条件放入查询条件；并执行action，返回searchResponse
    SearchResponse searchResponse = builder.addAggregation(termsAggregationBuilder).get();
    //5、获取聚合结果
    Aggregations aggregations = searchResponse.getAggregations();
    
    //遍历
    for (Aggregation aggregation : aggregations) {
        System.out.println(aggregation.toString());
    }
}

9、需求七：聚合排序

计算每个球队总年薪，并按照总年薪倒序排列
sql实现：select team, sum(salary) as total_salary from player group by team order by total_salary desc;

@Test
public void orderBySum(){
    //1、构建查询提交
    SearchRequestBuilder builder = client.prepareSearch("player").setTypes("player");
    //2、指定聚合条件
    TermsAggregationBuilder teamGroup = AggregationBuilders.terms("team_group").field("team").order(BucketOrder.count(true));
    SumAggregationBuilder sumMoney = AggregationBuilders.sum("sum_money").field("salary");
    //3、指定多个分组条件的先后顺序关系
    TermsAggregationBuilder termsAggregationBuilder = teamGroup.subAggregation(sumMoney);
    //4、将聚合条件放入查询条件；并执行action，返回searchResponse
    SearchResponse searchResponse = builder.addAggregation(termsAggregationBuilder).get();
    Map<String, Aggregation> stringAggregationMap = searchResponse.getAggregations().asMap();
    System.out.println(stringAggregationMap);
    //5、获取聚合结果
    Aggregations aggregations = searchResponse.getAggregations();
    //遍历聚合结果
    for (Aggregation aggregation : aggregations) {
        System.out.println(aggregation.toString());
    }
}

 

fengge18306
关注
ElasticSearch的java高级API操作教程
qq_44299928的博客
07-02 680
ElasticSearch的java高级API操作教程 概要 这套API是ES官方提供的，用于java操作ES。maven项目直接导入依赖。 <dependency> <groupId>org.elasticsearch.client</groupId> <artifactId>elasticsearch-rest-high-level-client</artifactId>
ES的javaAPI操作
Imflash的博客
09-22 5719
文章目录12、使用Java API访问集群1、导入pom2、创建索引 prepareIndex1、创建Client2、自己拼装json创建索引保存到myindex1索引库下面的article当中去3、使用map创建索引4、XcontentBuilder实现创建索引5、将对象转换为json格式字符串进行创建索引6、批量创建索引3、更新索引4、删除索引1、按照id进行删除2、删除整个索引库5、查询索引...
Elasticsearch-Java高级API的简单使用
CoreCmd的博客
10-31 760
package com.corecmd.webapp.tiansjportal; import com.alibaba.fastjson.JSON; import com.corecmd.webapp.tiansjportal.common.enums.ResourceTypeEnum; import com.corecmd.webapp.tiansjportal.common.utils.DateUtil; import com.corecmd.webapp.tiansjportal.elasticse
elasticsearch的学习（二）：Java api操作elasticsearch
最新发布
weixin_45037073的博客
08-05 776
使用Java api操作elasticsearch。
java es 如何查询,如何在elasticsearch中获得查询的最大分数？
weixin_42510600的博客
03-19 1173
我有一个存储在elasticsearch索引中的大型文档集，我需要找到类似的文档集来排除重复项 .不幸的是，这些文档可能有不同的值，所以我不能完全依赖过滤器 . 相反，我试图评估使用多个字段和不同提升值的两个文档之间的差异 .如果差异太大，则文档不会计为重复 . 问题是 - 我不知道如何评估差异，因为搜索响应中的_score没有说明差异有多大 .为每个特定查询获得最大可能得分是完美的 . 我怎样才...
es界面的分组，求平均值的操作
dingjue6870的博客
09-20 387
第一个分析需求：计算每个tag下的商品数量 默认情况下，大部分字段都是被索引的（有个倒排索引），以使得他们可以被搜索。 然而，在脚本中排序、聚合和访问字段的值，需要不同的搜索访问模式。 搜索需要回答的问题是“哪些文档包含这些搜索的内容？”，而排序和聚合需要回答的问题是“这个文档中这个字段的值是什么？” 大部分字段都可以使用index-time，磁盘上的doc_values用于这个数...
基于Elasticsearch Java API的参考手册
04-29
Java API是Elasticsearch官方提供的与Elasticsearch服务器进行交互的主要工具，它使得开发者能够用Java语言便捷地进行索引、搜索、聚合等多种操作。 ### 一、Elasticsearch核心概念 1. **节点(Node)**: Elastic...
javaAPI操作Elasticsearch_elasticsearch 修改字段 java api
m0_63174529的博客
04-07 1012
最近很多小伙伴找我要Linux学习资料，于是我翻箱倒柜，整理了一些优质资源，涵盖视频、电子书、PPT等共享给大家！最近很多小伙伴找我要Linux学习资料，于是我翻箱倒柜，整理了一些优质资源，涵盖视频、电子书、PPT等共享给大家！
elasticsearch java api 离线文档
01-11
在 Java 应用程序中使用 Elasticsearch，开发者可以利用 Java API 来执行索引、搜索、聚合、更新和删除等操作。这些操作使得 Elasticsearch 成为大数据分析、日志处理和实时搜索等场景的理想选择。 **1. 索引操作**...
Elasticsearch5.x Java API手册
06-14
总之，Elasticsearch 5.x Java API 手册为开发者提供了详尽的操作指南，涵盖了从基础操作到高级特性的全面内容。通过深入理解和熟练应用这些 API，开发者可以高效地利用 Elasticsearch 实现各种数据处理任务。
【Elasticsearch Rest API版】聚合操作（分组，平均值）
深漂小码哥
06-28 527
1.请求方式：GET 2.请求URL: http://127.0.0.1:9200/shopping/_search 3.请求参数： { "aggs" : { // 聚合操作 "price_group" : { // 统计结果名称 "terms" : { // 分组 "field" : "price" // 分组字段 } } }, "size": 0 } .
ElasticSearch-查询
xiaoyixiao_的博客
07-10 630
ElasticSearch-查询
Elasticsearch 聚合查询(aggs)，java后端面试常见问题
m0_63174618的博客
03-14 1108
分享一套我整理的面试干货，这份文档结合了我多年的面试官经验，站在面试官的角度来告诉你，面试官提的那些问题他最想听到你给他的回答是什么，分享出来帮助那些对前途感到迷茫的朋友。
JAVA代码实现ElasticSearch搜索（入门-进阶）(二):聚合函数，group by 分组 ，分桶，桶聚合 bucketing，双重聚合
majunssz的博客
05-24 4713
JAVA代码实现ElasticSearch搜索（入门-进阶）(二):聚合函数 （group by），双重聚合
ElasticSearch的多字段分组聚合的三种实现方式
u011250186的博客
06-20 6650
ElasticSearch的分组聚合
Elasticsearch Java API 分组、聚合、嵌套相关查询
qq_34910179的博客
06-24 1万+
Elasticsearch Java API 分组、聚合、嵌套相关查询 翼支付监控系统正使用es做后端存储，这边我们是将日志计算处理过后的数据通过kafka储存到es。选择用es作为数据储存端是考虑到es有一套完整的数据处理方式，功能全面性能优越，以及索引滚动可以方便管理es存储的数据。这理我主要是分享下Elasticsearch Java API对ES数据分组、聚合、嵌套以及时间直方图方面相关查...
原生查询
qq_43655622的博客
05-10 192
1.原生查询 1.1.查询 @Autowired ItemRepository itemRepository; @Test public void testquery(){ //查询构建器 NativeSearchQueryBuilder queryBuilder = new NativeSearchQueryBuilder(); //添加查询条件 queryBuilder.withQuery(QueryBuilders.matchQuery("title","小米手机"))
elasticsearch 多字段分组聚合分页查询功能实现
春风化雨
09-28 2万+
1、按照不同字段分组聚合 2、包括按照时间月份分组 3、支持分页查询 以下贴出代码实现，仅供参考，如有好的方案，敬请留言： @Override public Pager findCusMap(CustMapConditionVO vo, Pager pager) { // getBoolQueryBuilder 是自写的方法，用来组装条件查询 Bo...
springboot中ElasticSearch入门与进阶：组合查询、Aggregation聚合查询（你想要的都有）
热门推荐
像雾像雨又像风_的博客
08-06 6万+
1.springboot中配置elasticSearch 1.1在工程中引入相关的jar包   1.1.1 在build.gradle中添加需要的jar包       我创建的gradle工程，对应的maven工程也是一样，添加对应的jar包即可 // 添加 Spring Data Elasticsearch 的依赖 compile('org.springframework.boot:...
Elasticsearch 1.4 Java API 教程
"Elasticsearch 1.4 Java API文档提供了关于如何使用Java与Elasticsearch 1.4版本进行交互的详细指南。这个API涵盖了从基础操作到高级特性的全面内容，包括 Maven 仓库信息、客户端使用、索引、获取、删除、批量操作...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值