ElasticSearch6.x版本聚合统计在Kibana上的实操和在SpringBoot上的实操

已于 2023-01-10 08:08:59 修改
阅读量1.3k 收藏 3
点赞数
分类专栏： 开发记录 文章标签： elasticsearch spring boot
于 2023-01-07 20:14:22 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/dgfdhgghd/article/details/128564487
版权

文章目录

一、教学讲解视频

教学讲解视频地址：视频地址

二、Kibana上操作

1.直方图聚合统计

①概念

直方图聚合是一种基于多桶值聚合，可从文档中提取的数值或数值范围值来进行聚合。它可以对参与聚合的值来动态的生成固定大小的桶。

②代码

“size”: 0 作用是： 不显示具体的内容

GET /online_house_achieve/house/_search
{
  "size": 0, 
  "aggs": {
    "test_histogram": {
      "histogram": {
        "field": "area",
        "interval": 5
      }
    }
  }
}

2.强制直方图聚合统计范围

①概念

使用extended_bounds可以进行强制指定直方图的统计起止范围。

②代码

注意：extended_bounds不会过滤分组，即使分组的值超过了extended_bounds的范围区间，也依然会显示。

GET /online_house_achieve/house/_search
{
  "size": 0, 
  "aggs": {
    "test_histogram": {
      "histogram": {
        "field": "area",
        "interval": 5,
        "extended_bounds":{
          "min": 0,
          "max": 10
        }
      }
    }
  }
}

3.直方图聚合统计排序

①概念

在直方图聚合统计之后，我们可以对统计结果进行排序，排序分两种，一个根据统计后的key值进行排序。另一种就是根据统计后的count值进行排序。

②代码

根据统计后的key值降序排序

GET /online_house_achieve/house/_search
{
  "size": 0, 
  "aggs": {
    "test_histogram": {
      "histogram": {
        "field": "area",
        "interval": 5,
        "order": {
          "_key": "desc"
        }
      }
    }
  }
}

根据统计后的count值降序排序

GET /online_house_achieve/house/_search
{
  "size": 0, 
  "aggs": {
    "test_histogram": {
      "histogram": {
        "field": "area",
        "interval": 5,
        "order": {
          "_count": "desc"
        }
      }
    }
  }
}

4.直方图聚合统计偏移

①概念

分组默认从0开始以interval为间隔步进，可以通过offset修改分组的开始位置，这样就可以从offset开始以interval为间隔步进。

②代码

GET /online_house_achieve/house/_search
{
  "size": 0, 
  "aggs": {
    "test_histogram": {
      "histogram": {
        "field": "area",
        "interval": 5,
        "offset": 3
      }
    }
  }
}

5.日期直方图聚合统计

①概念

interval(时间间隔)的可用表达式：

  • year 1y 年
  • quarter 1q 季度
  • month 1M 月份
  • week 1w 星期
  • day 1d 天
  • hour 1h 小时
  • minute 1m 分钟
  • second 1s 秒

②代码

把符合记录的最早时间和最晚时间为范围，根据每月1号(1M)为区间对范围进行切分

GET /online_house_achieve/house/_search
{
  "size": 0, 
  "aggs": {
    "test_date_histogram": {
      "date_histogram": {
        "field": "updateTime",
        "interval": "1M",
        "format": "yyyy-MM-dd HH:mm:ss"
      }
    }
  }
}

6.日期范围聚合统计

①概念

通过range查询某个日期范围内的数据个数统计。

②代码

/M 精确到月份
now 当前时间
time_zone 设置时区，默认是UTC，也就是现在时间会相差8h
假设现在(now)是2023年1月6日，这里就是查询日期范围为[2022-11-01, 2022-12-06]之间的数据个数。

GET /online_house_achieve/house/_search
{
  "size": 0, 
  "aggs": {
    "test_date_range": {
      "date_range": {
        "field": "updateTime",
        "format": "yyyy-MM-dd", 
        "time_zone": "+08:00",
        "ranges": [
          {
            "from": "now-2M/M",
            "to": "now-1M"
          }
        ]
      }
    }
  }
}

7.过滤、多重过滤直方图聚合统计

①概念

使用filter在聚合统计前过滤出符合条件的数据。

②代码

先过滤出money字段值大于2500的数据，然后对过滤出的数据进行interval为10的区间范围大小进行聚合统计。

GET /online_house_achieve/house/_search
{
  "size": 0, 
  "aggs": {
    "test_filter": {
      "aggs": {
        "test_histogram": {
          "histogram": {
            "field": "area",
            "interval": 10
          }
        }
      },
      "filter": {
        "range": {
          "money": {
            "gte": 2500
          }
        }
      }
    }
  }
}

多重过滤的话，我们可以使用filters实现。
注意：多重过滤是分别过滤然后分别聚合统计。

GET /online_house_achieve/house/_search
{
  "size": 0, 
  "aggs": {
    "test_filter": {
      "aggs": {
        "test_histogram": {
          "histogram": {
            "field": "area",
            "interval": 10
          }
        }
      },
      "filters": {
        "filters": {
          "test_range1": {
            "range": {
              "money": {
                "gte": 2800
              }
            }
          },
          "test_range2" :{
            "range": {
              "id": {
                "lte": 5
              }
            }
          }
        }
      }
    }
  }
}

8.空值聚合统计

①概念

使用missing可以把指定字段为null的数据统计出来。

②代码

GET /online_house_achieve/house/_search
{
  "size": 0, 
  "aggs": {
    "test_missing": {
      "missing": {
        "field": "user.password"
      }
    }
  }
}

9.平均、最大、最小和求和的聚合统计

①概念

使用avg max min sum可以对某字段分别进行求平均、求最大、求最小和求和的操作。

②代码

平均

GET /online_house_achieve/house/_search
{
  "size": 0, 
   "aggs" : {
      "avg_grade" : { "avg" : { "field" : "area" } }
   }
}

最大

GET /online_house_achieve/house/_search
{
  "size": 0, 
   "aggs" : {
      "max_grade" : { "max" : { "field" : "area" } }
   }
}

最小

GET /online_house_achieve/house/_search
{
  "size": 0, 
   "aggs" : {
      "min_grade" : { "min" : { "field" : "area" } }
   }
}

求和

GET /online_house_achieve/house/_search
{
  "size": 0, 
   "aggs" : {
      "sum_grade" : { "sum" : { "field" : "area" } }
   }
}

一次性查询最大、最小、平均、求和
写法一

GET /online_house_achieve/house/_search
{
  "size": 0,
  "aggs":{
    "max_area":{
      "max":{
        "field":"area"
      }
    },
    "min_area":{
      "min":{
        "field":"area"
      }
    },
    "avg_area":{
      "avg":{
        "field":"area"
      }
    },
    "sum_area":{
      "sum":{
        "field":"area"
      }
    }
  }
}

写法二

GET /online_house_achieve/house/_search
{
  "size":0,
  "aggs":{
    "area_stats":{
      "stats":{
        "field":"area"
      }
    }
  }
}

10.去重聚合统计

①概念

area_count 取名，随便定义即可。
使用cardinality即可实现去重。

②代码

GET /online_house_achieve/house/_search
{
  "size":0,
  "aggs":{
    "area_count":{
      "cardinality": {
        "field": "area"
      }
    }
  }
}

11.分组聚合统计

①概念

根据category字段分组，然后求每个分组的area字段的平均值

②代码

GET /online_house_achieve/house/_search
{
  "size": 0,
  "aggs":{
    "group_search":{
      "terms":{
        "field":"category"
      },
      "aggs":{
        "avg_area":{
          "avg":{
            "field":"area"
          }
        }
      }
    }
  }
}

12.分组聚合统计之取Top N

①概念

使用top_hits可以对分组后的结果，取前N条数据。

②代码

GET /online_house_achieve/house/_search
{
  "size": 0,
  "aggs":{
    "group_search":{
      "terms":{
        "field":"category"
      },
      "aggs":{
        "top_area_hits":{
          "top_hits":{
            "sort":[
              {
                "area":{
                  "order":"desc"
                }
              }
            ],
            "_source":{
              "includes":["area","id","category"]
            },
            "size": 3
          }
        }
      }
    }
  }
}

13.百分位聚合统计

①概念

百分位数（percentiles）：统计学术语，如果将一组数据从小到大排序，并计算相应的累计百分位，则某一百分位所对应数据的值就称为这一百分位的百分位数。可表示为：一组n个观测值按数值大小排列。如，处于p%位置的值称第p百分位数。

举个栗子~

今年是单位体检的日子，所有人到体检中心来测身高。
单位一共100个人，所有人的身高都在 163cm-190cm 之间。同事 A 的身高值是180cm处于百分位70%。也就是说第70百分位数为180cm。
那么我们就可以理解，同事 A 的身高比公司中70%的人都高，比其他30%的人要矮。

②代码

这里默认展示1%、5%、25%、50%、75%、95%、99%对应的具体数值

GET /online_house_achieve/house/_search
{
  "size":0,
  "aggs":{
    "area_percentiles":{
      "percentiles":{
        "field": "area",
        "keyed": false
      }
    }
  }
}

当然，如果不想用系统默认的百分位，也可以自己指定~
指定值去查百分位占比

GET /online_house_achieve/house/_search
{
  "size": 0,
  "aggs":{
    "area_percentiles":{
      "percentile_ranks":{
        "field": "area",
        "values": [22, 50, 73],
        "keyed": false
      }
    }
  }
}

指定百分位占比去查对应值
这里也相当于是在查中位数

GET /online_house_achieve/house/_search
{
  "size":0,
  "aggs":{
    "area_percentiles":{
      "percentiles":{
        "field":"area",
        "percents":[50],
        "keyed":false
      }
    }
  }
}

三、SpringBoot上操作

以下在SpringBoot操作的代码都是根据上面的Kibana操作的代码转换而来

1.直方图聚合统计

 SearchRequest searchRequest = new SearchRequest();
 SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
 HistogramAggregationBuilder aggregationBuilder = AggregationBuilders
          .histogram("test_histogram")
          .field("area")
          .interval(5);
 searchSourceBuilder.aggregation(aggregationBuilder);
 searchSourceBuilder.size(0);
 searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
 SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
 Aggregations aggregations = search.getAggregations();
 ParsedHistogram parsedHistogram = aggregations.get("test_histogram");
 parsedHistogram.getBuckets().forEach(bucket -> {
     logger.info("key: {}", bucket.getKey()); //阶梯值
     logger.info("count: {}", bucket.getDocCount()); //获取总数
 });

2.强制直方图聚合统计范围

 SearchRequest searchRequest = new SearchRequest();
 SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
 HistogramAggregationBuilder aggregationBuilder = AggregationBuilders
          .histogram("test_histogram")
          .field("area")
          .interval(5)
          .extendedBounds(0, 10);
 searchSourceBuilder.aggregation(aggregationBuilder);
 searchSourceBuilder.size(0);
 searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
 SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
 Aggregations aggregations = search.getAggregations();
 ParsedHistogram parsedHistogram = aggregations.get("test_histogram");
 parsedHistogram.getBuckets().forEach(bucket -> {
     logger.info("key: {}", bucket.getKey()); //阶梯值
     logger.info("count: {}", bucket.getDocCount()); //获取总数
 });

3.直方图聚合统计排序

根据统计后的key值降序排序

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
HistogramAggregationBuilder aggregationBuilder = AggregationBuilders
        .histogram("test_histogram")
        .field("area")
        .interval(5)
        .order(BucketOrder.aggregation("_key", false));
searchSourceBuilder.aggregation(aggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedHistogram parsedHistogram = aggregations.get("test_histogram");
parsedHistogram.getBuckets().forEach(bucket -> {
    logger.info("key: {}", bucket.getKey()); //阶梯值
    logger.info("count: {}", bucket.getDocCount()); //获取总数
});

根据统计后的count值降序排序

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
HistogramAggregationBuilder aggregationBuilder = AggregationBuilders
        .histogram("test_histogram")
        .field("area")
        .interval(5)
        .order(BucketOrder.aggregation("_count", false));
searchSourceBuilder.aggregation(aggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedHistogram parsedHistogram = aggregations.get("test_histogram");
parsedHistogram.getBuckets().forEach(bucket -> {
    logger.info("key: {}", bucket.getKey()); //阶梯值
    logger.info("count: {}", bucket.getDocCount()); //获取总数
});

4.直方图聚合统计偏移

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
HistogramAggregationBuilder aggregationBuilder = AggregationBuilders
        .histogram("test_histogram")
        .field("area")
        .interval(5)
        .offset(3);
searchSourceBuilder.aggregation(aggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedHistogram parsedHistogram = aggregations.get("test_histogram");
parsedHistogram.getBuckets().forEach(bucket -> {
    logger.info("key: {}", bucket.getKey()); //阶梯值
    logger.info("count: {}", bucket.getDocCount()); //获取总数
});

5.日期直方图聚合统计

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
DateHistogramAggregationBuilder dateHistogramAggregationBuilder = AggregationBuilders
        .dateHistogram("test_date_histogram")
        .field("updateTime")
        .dateHistogramInterval(DateHistogramInterval.MONTH)
        .format("yyyy-MM-dd HH:mm:ss");
searchSourceBuilder.aggregation(dateHistogramAggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedDateHistogram parsedDateHistogram = aggregations.get("test_date_histogram");
parsedDateHistogram.getBuckets().forEach(bucket -> {
    logger.info("keyString: {}", bucket.getKeyAsString()); //字符串阶梯值
    logger.info("key: {}", bucket.getKey()); //阶梯值
    logger.info("count: {}", bucket.getDocCount()); //获取总数
});

6.日期范围聚合统计

 SearchRequest searchRequest = new SearchRequest();
 SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
 DateRangeAggregationBuilder dateRangeAggregationBuilder = AggregationBuilders
         .dateRange("test_date_range")
         .field("updateTime")
         .format("yyyy-MM-dd")
         .timeZone(DateTimeZone.forOffsetHours(8))
         .addRange("now-2M/M", "now-1M");
 searchSourceBuilder.aggregation(dateRangeAggregationBuilder);
 searchSourceBuilder.size(0);
 searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
 SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
 Aggregations aggregations = search.getAggregations();
 ParsedRange parsedRange = aggregations.get("test_date_range");
 parsedRange.getBuckets().forEach(bucket -> {
     logger.info("key: {}", bucket.getKey());
     logger.info("fromString: {}", bucket.getFromAsString());
     logger.info("toString: {}", bucket.getToAsString());
     logger.info("count: {}", bucket.getDocCount());
 });

7.过滤、多重过滤直方图聚合统计

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
FilterAggregationBuilder filterAggregationBuilder = AggregationBuilders
        .filter("test_filter", QueryBuilders.rangeQuery("money").gte(2500));
HistogramAggregationBuilder histogramAggregationBuilder = AggregationBuilders
        .histogram("test_histogram")
        .field("area")
        .interval(10);
filterAggregationBuilder.subAggregation(histogramAggregationBuilder);
searchSourceBuilder.aggregation(filterAggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedFilter parsedFilter = aggregations.get("test_filter");
logger.info("过滤总数：{}", parsedFilter.getDocCount());
ParsedHistogram parsedHistogram = parsedFilter.getAggregations().get("test_histogram");
parsedHistogram.getBuckets().forEach(bucket -> {
    logger.info("key: {}", bucket.getKey()); //阶梯值
    logger.info("count: {}", bucket.getDocCount()); //获取总数
});

多重过滤

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();

FiltersAggregationBuilder filtersAggregationBuilder = AggregationBuilders
        .filters("test_filter",
                QueryBuilders.rangeQuery("money").gte(2800),
                QueryBuilders.rangeQuery("id").lte(5));
HistogramAggregationBuilder histogramAggregationBuilder = AggregationBuilders
        .histogram("test_histogram")
        .field("area")
        .interval(10);
filtersAggregationBuilder.subAggregation(histogramAggregationBuilder);
searchSourceBuilder.aggregation(filtersAggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedFilters parsedFilters = aggregations.get("test_filter");
parsedFilters.getBuckets().forEach(bucket -> {
    if("0".equals(bucket.getKey())) {
        logger.info("第一个过滤聚合后的结果...");
        ParsedHistogram parsedHistogram = bucket.getAggregations().get("test_histogram");
        parsedHistogram.getBuckets().forEach(e -> {
            logger.info("key：{}", e.getKey()); //阶梯值
            logger.info("count：{}", e.getDocCount()); //获取总数
        });
    } else if ("1".equals(bucket.getKey())) {
        logger.info("第二个过滤聚合后的结果...");
        ParsedHistogram parsedHistogram = bucket.getAggregations().get("test_histogram");
        parsedHistogram.getBuckets().forEach(e -> {
            logger.info("key：{}", e.getKey()); //阶梯值
            logger.info("count：{}", e.getDocCount()); //获取总数
        });
    }
});

8.空值聚合统计

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
MissingAggregationBuilder missingAggregationBuilder = AggregationBuilders
        .missing("test_missing")
        .field("user.password");
searchSourceBuilder.aggregation(missingAggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedMissing parsedMissing = aggregations.get("test_missing");
logger.info("count: {}", parsedMissing.getDocCount()); // 获取总数

9.平均、最大、最小和求和的聚合统计

平均

 SearchRequest searchRequest = new SearchRequest();
 SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
 AvgAggregationBuilder avgAggregationBuilder = AggregationBuilders.avg("avg_area").field("area");
 searchSourceBuilder.aggregation(avgAggregationBuilder);
 searchSourceBuilder.size(0);
 searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
 SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
 Aggregations aggregations = search.getAggregations();
 ParsedAvg parsedAvg = aggregations.get("avg_area");
 logger.info("平均值:{}", parsedAvg.getValue());

最大

 SearchRequest searchRequest = new SearchRequest();
 SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
 MaxAggregationBuilder maxAggregationBuilder = AggregationBuilders.max("max_area").field("area");
 searchSourceBuilder.aggregation(maxAggregationBuilder);
 searchSourceBuilder.size(0);
 searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
 SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
 Aggregations aggregations = search.getAggregations();
 ParsedMax parsedMax = aggregations.get("max_area");
 logger.info("最大值:{}", parsedMax.getValue());

最小

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
MinAggregationBuilder minAggregationBuilder = AggregationBuilders.min("min_area").field("area");
searchSourceBuilder.aggregation(minAggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedMin parsedMin = aggregations.get("min_area");
logger.info("最小值:{}", parsedMin.getValue());

求和

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
SumAggregationBuilder sumAggregationBuilder = AggregationBuilders.sum("sum_area").field("area");
searchSourceBuilder.aggregation(sumAggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedSum parsedSum = aggregations.get("sum_area");
logger.info("求和:{}", parsedSum.getValue());

一次性查询最大、最小、平均、求和
写法一

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
MaxAggregationBuilder maxAggregationBuilder = AggregationBuilders
        .max("max_area").field("area");
MinAggregationBuilder minAggregationBuilder = AggregationBuilders
        .min("min_area").field("area");
AvgAggregationBuilder avgAggregationBuilder = AggregationBuilders
        .avg("avg_area").field("area");
SumAggregationBuilder sumAggregationBuilder = AggregationBuilders
        .sum("sum_area").field("area");
searchSourceBuilder
        .aggregation(avgAggregationBuilder)
        .aggregation(maxAggregationBuilder)
        .aggregation(minAggregationBuilder)
        .aggregation(sumAggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedMax parsedMax = aggregations.get("max_area");
ParsedMin parsedMin = aggregations.get("min_area");
ParsedAvg parsedAvg = aggregations.get("avg_area");
ParsedSum parsedSum = aggregations.get("sum_area");
logger.info("最大值:{}", parsedMax.getValue());
logger.info("最小值:{}", parsedMin.getValue());
logger.info("平均值:{}", parsedAvg.getValue());
logger.info("求和值:{}", parsedSum.getValue());

写法二

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
StatsAggregationBuilder statsAggregationBuilder = AggregationBuilders
        .stats("area_status").field("area");
searchSourceBuilder.aggregation(statsAggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedStats parsedStats = aggregations.get("area_status");
logger.info("最大值:{}", parsedStats.getMax());
logger.info("最小值:{}", parsedStats.getMin());
logger.info("平均值:{}", parsedStats.getAvg());
logger.info("求和值:{}", parsedStats.getSum());

10.去重聚合统计

 SearchRequest searchRequest = new SearchRequest();
 SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
 CardinalityAggregationBuilder cardinalityAggregationBuilder = AggregationBuilders
         .cardinality("area_count").field("area");
 searchSourceBuilder.aggregation(cardinalityAggregationBuilder);
 searchSourceBuilder.size(0);
 searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
 SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
 Aggregations aggregations = search.getAggregations();
 ParsedCardinality parsedCardinality = aggregations.get("area_count");
 logger.info("统计个数:{}", parsedCardinality.getValue());

11.分组聚合统计

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
TermsAggregationBuilder termsAggregationBuilder = AggregationBuilders
        .terms("group_search")
        .field("category");
AvgAggregationBuilder avgAggregationBuilder = AggregationBuilders.avg("avg_area").field("area");
termsAggregationBuilder.subAggregation(avgAggregationBuilder);
searchSourceBuilder.aggregation(termsAggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedTerms parsedTerms = aggregations.get("group_search");
parsedTerms.getBuckets().forEach(bucket -> {
    logger.info("分组值：{}", bucket.getKey());
    logger.info("分组包含个数：{}", bucket.getDocCount());
    ParsedAvg parsedAvg = bucket.getAggregations().get("avg_area");
    logger.info("分组后的平均值：{}", parsedAvg.getValue());
});

12.分组聚合统计之取Top N

 SearchRequest searchRequest = new SearchRequest();
 SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
 TermsAggregationBuilder termsAggregationBuilder = AggregationBuilders
         .terms("group_search")
         .field("category");
 String[] include = {"area", "id", "category"};
 String[] exclude = {};
 TopHitsAggregationBuilder topHitsAggregationBuilder = AggregationBuilders
         .topHits("top_area_hits")
         .sort("area", SortOrder.DESC)
         .fetchSource(include, exclude);
 termsAggregationBuilder.subAggregation(topHitsAggregationBuilder);
 searchSourceBuilder.aggregation(termsAggregationBuilder);
 searchSourceBuilder.size(0);
 searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
 SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
 Aggregations aggregations = search.getAggregations();
 ParsedTerms parsedTerms = aggregations.get("group_search");
 parsedTerms.getBuckets().forEach(bucket -> {
     logger.info("分组值：{}", bucket.getKey());
     logger.info("分组包含个数：{}", bucket.getDocCount());
     ParsedTopHits parsedTopHits = bucket.getAggregations().get("top_area_hits");
     SearchHit[] hits = parsedTopHits.getHits().getHits();
     for (SearchHit hit : hits) {
         logger.info("数据：{}", hit.getSourceAsString());
    }
 });

13.百分位聚合统计

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
PercentilesAggregationBuilder percentilesAggregationBuilder = AggregationBuilders
        .percentiles("area_percentiles")
        .field("area")
        .keyed(false);
searchSourceBuilder.aggregation(percentilesAggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedPercentiles parsedPercentiles = aggregations.get("area_percentiles");
parsedPercentiles.forEach(e -> {
    logger.info("百分位数：{}", e.getPercent());
    logger.info("对应数值：{}", e.getValue());
});

指定值去查百分位占比

SearchRequest searchRequest = new SearchRequest();
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
double[] values = {22, 50, 73};
PercentileRanksAggregationBuilder percentileRanksAggregationBuilder = AggregationBuilders
        .percentileRanks("area_percentiles", values)
        .field("area")
        .keyed(false);
searchSourceBuilder.aggregation(percentileRanksAggregationBuilder);
searchSourceBuilder.size(0);
searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
Aggregations aggregations = search.getAggregations();
ParsedPercentileRanks parsedPercentileRanks = aggregations.get("area_percentiles");
parsedPercentileRanks.forEach(e -> {
    logger.info("百分位数：{}", e.getPercent());
    logger.info("对应数值：{}", e.getValue());
});

指定百分位占比去查对应值

 SearchRequest searchRequest = new SearchRequest();
 SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
 double[] values = {50};
 PercentilesAggregationBuilder percentilesAggregationBuilder = AggregationBuilders
         .percentiles("area_percentiles")
         .percentiles(values)
         .field("area")
         .keyed(false);
 searchSourceBuilder.aggregation(percentilesAggregationBuilder);
 searchSourceBuilder.size(0);
 searchRequest.indices("online_house_achieve").types("house").source(searchSourceBuilder);
 SearchResponse search = restHighLevelClient.search(searchRequest, RequestOptions.DEFAULT);
 Aggregations aggregations = search.getAggregations();
 ParsedPercentiles parsedPercentiles = aggregations.get("area_percentiles");
 parsedPercentiles.forEach(e -> {
     logger.info("百分位数：{}", e.getPercent());
     logger.info("对应数值：{}", e.getValue());
 });
这里是杨杨吖
关注
专栏目录
大数据与Elasticsearch结合kibana可视化展示
zenglaoshi的博客
11-26 1065
大数据与Elasticsearch结合kibana可视化展示 安装hadoop2.7.3版本（官方推荐）（PS：hadoop3.+以上不支持，试过），hadoop可以搭全分布式和伪分布式，我是用伪分布式。 一、Hadoop伪分布式搭建： 解压Hadoop2.7.3： 1、固定ip 将集群中每一台主机ip设为静态，并且可以相互通信 先使用ifconfig查看当前网卡名称 2 设置每一台机器自己的主机...
Elasticsearch 之（6）kibana嵌套聚合，下钻分析，聚合分析
热门推荐
vincent
05-18 1万+
计算每个tag下的商品数量GET /ecommerce/product/_search { "aggs": { "group_by_tags": { "terms": { "field": "tags" } } } }将文本field的fielddata属性设置为true （正排索引 用于嵌套聚合查询， 后面会详细描述）PUT /ecommerce/_mappi...
利用kibana可视化DevTools界面实现ElasticSearch文档数据的聚合查询
c_xiao_dian_dian的博客
07-09 670
聚合（aggregations）可以实现对文档数据的统计、分析、运算。聚合常见的有三类： 1、桶（Bucket）聚合：用来对文档做分组 •TermAggregation：按照文档字段值分组 •Date Histogram：按照日期阶梯分组，例如一周为一组，或者一月为一组 2、度量（Metric）聚合：用以计算一些值，比如：最大值、最小值、平均值等 •Avg：求平均值 •Max：求最大值 •Min：求最小值 •Stats：同时求max、min、avg、sum等
Kibana操作Elasticsearch-Aggregations聚合数据分析
程序员劝退师的博客
07-10 2725
这篇文章呢，主要演示Kibana操作Elasticsearch做数据分析 聚合 Aggregations 聚合提供了从数据中分组和提取数据的能力。最简单的聚合方法大致等于SQL GROUPBY和SQL聚合函数。在Elasticsearch中,您有执行搜索返回hits (命中结果) ,并且同时返回聚合结果,把一个响应中的所有hits (命中结果)分隔开的能力。这是非常强大且有效的,您可以执行查询和多个聚合,并且在一次使用中得到各自的(任何一个的)返回结果,使用一次简洁和简化的API来避免网络往返。 基本操作
Kibana分组聚合数据之Data Table篇
阿甘修行的专栏
01-08 5384
1 操作步骤 1.1 登录Kibana http://xxx.xxx.com/app/kibana 1.2 选择Visualize 1.3 create new visualization 1.4 选择Data Table 1.5 选择索引 1.6 配置搜索时间&日志级别&应用 1.7 配置分组&排序 1.7.1 示例图片 右侧即需要的数据。 1.7.2 me...
kibana嵌套聚合，下钻分析，聚合分析
弱水三千12138的博客
02-23 1589
1. bucket和metric city name 北京 小李 北京 小王 上海 小张 上海 小丽 上海 小陈 基于city划分buckets 划分出来两个bucket，一个是北京bucket，一个是上海bucket 北京bucket：包含了2个人，小李，小王 上海bucket：包含了3个人，小张，小丽，小陈 按照某个字段进行bucket划分，那个字段的值相同的那些数据，就会被划分到一个...
springboot1.x整合elasticsearch5.x
05-12
总之，整合Spring Boot 1.x和Elasticsearch 5.x虽然需要克服一些兼容性问题，但通过选择合适的库版本、正确配置和使用Spring Data Elasticsearch的功能，你依然可以构建出高效的搜索和分析系统。
基于springboot 整合 elasticsearch 7.x版本实现增删改查代码demo演示
最新发布
06-21
java整合Es的7x增删改查 延伸阅读 #####添加数据的语法 put PUT /demo-index/_doc/1 { "name" : "John", "address" : "贵州市贵阳市南明区油炸街", "age" : 25, "times" : 1655465455124 } PUT /demo-index/_...
弹性演示：SpringBoot + elasticsearch6.x + mybatis
01-31
SpringBoot + elasticsearch6.x构建的es全文搜索服务demo，主要技术： 1，SpringBoot + Mybatis + Elasticsearch6.x框架 2，使用RestHighLevelClient作为搜索java api 3，使用LogStash同步mysql数据 环境安装 创建...
elasticsearch下载太慢在国内, 我把包放到了云盘上,还有kibana.有需要自取,持续更新版本
01-07
国内下载elasticsearch哪叫一个慢, 为了方便大家学习, 博主将下载好的包放到云盘. 官网下载地址:https://www.elastic.co/cn/downloads/elasticsearch 要验证包的完整性可以计算文件哈希值(官网有提供sha512的值, ...
最新版windows kibana-7.17.6-windows-x86_64.zip
09-02
《深入理解Kibana 7.17.6在Windows上的应用》 Kibana是Elastic Stack（以前称为ELK Stack，包括Elasticsearch、Logstash和Kibana）的重要组成部分，它是一款数据可视化工具，能帮助用户通过交互式仪表板对Elastic...
ElasticSearch全文搜索引擎之Aggregation聚合查询(结合Kibana)
weixiaohuai的博客
10-11 4124
一、简介 前面一篇文章已经详细介绍了查询相关的API，但是当时并没有总结关于Aggregation聚合查询这一方面的内容，本篇文章单独对聚合查询做一个总结。 聚合查询提供了功能可以分组并统计你的数据。理解聚合最简单的方式就是可以把它粗略的看做SQL的GROUP BY操作和SQL的聚合函数。 ElasticSearch中常用的聚合有两种： metric（度量）聚合：度量类型聚合主要针对的number类型的数据，需要ES做比较多的计算工作，类似于关系型数据库的组函数操作； bucketing（桶）聚合
Kibana 用户指南（分析查询和聚合）
weixin_34417200的博客
09-14 2924
分析查询和聚合 Elasticsearch具有强大的分析器API，可用于检查和分析你的搜索查询，然而，响应是一个非常大的JSON blob，很难手工分析。 X-Pack包含Search Profiler工具，可以将此JSON输出转换为易于导航的可视化，使你能够更快地诊断和调试性能较差的查询。 入门 在Kibana中自动启用搜索概要分析器...
kibana对Elasticsearch做增删改查操作，以及一些聚合查询
dfBeautifulLive的博客
01-03 4405
kibana是一个可视化平台，设计出来用于和Elasticsearch一起使用的。你可以用kibana搜索、查看、交互存放在Elasticsearch索引里的数据。 准备工作:Elasticsearch启动完毕，elasticsearch-head启动完毕 kibana 启动完毕 然后访问http://localhost:5601,点击Dev Tools，就是以下图片的界面.  然后我们...
Kibana聚合操作
曾经蜡笔没有小新
06-20 9673
分组统计 相当于sql：select count(*),place from product group by place limit 0,3 GET how2java/_search { "size": 0, "aggs": { "group_by_place": { "terms": { "field": "place.keyword", ...
kibana es创建模板，索引，导入数据，简单聚合查询
u012189747的博客
03-31 5712
kibana es创建模板，索引，导入数据，聚合查询
记录使用ES+Kibana
weixin_43237770的博客
07-26 229
遇到的问题 创建随从节点无法加入主节点： [slave1] failed to join {master}{9gxzTsL4S_qK5TN4ckHmgQ}{o0i8E3k3Q0K_Ymva5QzD4Q}{127.0.0.1}{127.0.0.1:9300} {ml.machine_memory=17179869184, ml.max_open_jobs=20, xpac...
Elasticsearch倒排索引、kibana、ES检索常用命令、ES进阶检索、ES聚合、SpringBoot整合Elasticsearch
projectNo的博客
09-24 1397
什么是Elasticsearch？ Elasticsearch是基于Elastic堆栈核心的分布式搜索和分析引擎。Logstash和Beats有助于收集、聚合和丰富数据，并将其存储在Elasticsearch中。Elasticsearch为所有类型的数据提供近乎实时的搜索和分析。无论对有结构化或非结构化文本、数字数据或地理空间数据，Elasticsearch都可以以支持快速搜索，以方式高效地存储和索引这些数据。可以简单的数据检索和聚合信息来分析数据的趋势和模式。随着数据量和查询量的增长，Elasticsea
kibana数据聚合的小技巧-饼图获取各种情况的占比
不忘初心，才能始终
05-09 4885
kibana中的饼图绘画如果是简单统计数量，可以使用count 1. 输入过滤条件 2.选择terms进行某个字段的拆分匹配 3.选择匹配的字段 4.选择排序的方式，默认使用指标中的count 5.降级分布的衰减范围，默认是 5，可以根据需要调整相应的值 6. 点击右上方的 ▶️ 图标 获得所需要的饼图 ...
Linux 6.x 安装Elasticsearch 5.x 步骤与问题解决
本文档是关于在Linux 6.x系统上安装Elasticsearch 5.x的详细步骤，包括了从安装Java 8环境到解决Elasticsearch不能以root用户运行的问题，以及处理运行时可能遇到的警告。 在安装Elasticsearch之前，首先要确保系统...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

这里是杨杨吖

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值