Elasticsearch 8.10.2版本简单聚合查询记录

最新推荐文章于 2024-05-21 11:29:37 发布
最新推荐文章于 2024-05-21 11:29:37 发布
阅读量127 收藏 1
点赞数 3
分类专栏： 笔记 文章标签： elasticsearch jenkins 大数据
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/weixin_53860667/article/details/137646930
版权

安装ik分词器。ik分词器的作者构建8.10.2的包，所以就先下载一个别的版本放在elasticsearch-8.10.2\plugins目录下，在pom.xml中修改版本号就可以了。

先准备数据

# 批量添加数据
PUT test_query
put test_query/_bulk
{"index": {"_index" : "test_query","_id":"1001"}}
{"id":"1001","name": "zhang san","age" : 30}
{"index": {"_index" : "test_query","_id":"1002"}}
{"id":"1002","name": "li si","age" : 40}
{"index": {"_index" : "test_query","_id":"1003"}}
{"id":"1003","name": "wang wu","age" : 50}
{"index": {"_index" : "test_query","_id":"1004"}}
{"id":"1004","name": "zhangsan","age" : 30}
{"index": {"_index" : "test_query","_id":"1005"}}
{"id":"1005","name": "lisi","age" : 40}
{"index": {"_index" : "test_query","_id":"1006"}}
{"id":"1006","name": "wangwu","age" : 50}


# 查询所有数据
GET test_query/_search
{
  "query":{
    "match_all": {}
  }
}

# 响应结果
{
  "took": 0,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 6,
      "relation": "eq"
    },
    "max_score": 1,
    "hits": [
      {
        "_index": "test_query",
        "_id": "1001",
        "_score": 1,
        "_source": {
          "id": "1001",
          "name": "zhang san",
          "age": 30
        }
      },
      {
        "_index": "test_query",
        "_id": "1002",
        "_score": 1,
        "_source": {
          "id": "1002",
          "name": "li si",
          "age": 40
        }
      },
      {
        "_index": "test_query",
        "_id": "1003",
        "_score": 1,
        "_source": {
          "id": "1003",
          "name": "wang wu",
          "age": 50
        }
      },
      {
        "_index": "test_query",
        "_id": "1004",
        "_score": 1,
        "_source": {
          "id": "1004",
          "name": "zhangsan",
          "age": 30
        }
      },
      {
        "_index": "test_query",
        "_id": "1005",
        "_score": 1,
        "_source": {
          "id": "1005",
          "name": "lisi",
          "age": 40
        }
      },
      {
        "_index": "test_query",
        "_id": "1006",
        "_score": 1,
        "_source": {
          "id": "1006",
          "name": "wangwu",
          "age": 50
        }
      }
    ]
  }
}

match是分词匹配查询，在上面添加数据的时候因为有空格所以Elasticsearch会认为是两个关键词



GET test_query/_search
{
  "query":{
    "match": {
      "name": "zhang li"
    }
  }
}

# 响应结果
{
  "took": 11,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 2,
      "relation": "eq"
    },
    "max_score": 1.3555918,
    "hits": [
      {
        "_index": "test_query",
        "_id": "1001",
        "_score": 1.3555918,
        "_source": {
          "id": "1001",
          "name": "zhang san",
          "age": 30
        }
      },
      {
        "_index": "test_query",
        "_id": "1002",
        "_score": 1.3555918,
        "_source": {
          "id": "1002",
          "name": "li si",
          "age": 40
        }
      }
    ]
  }
}

查询不出来，因为这是两个关键词

# 完整的关键词查询 
GET test_query/_search
{
  "query":{
    "term": {
      "name": {
        "value": "zhang san" 
      }
    }
  }
}

# 响应结果
{
  "took": 0,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 0,
      "relation": "eq"
    },
    "max_score": null,
    "hits": []
  }
}

可以查询，因为这是完整的关键词

# 完整的关键词查询
GET test_query/_search
{
  "query":{
    "term": {
      "name": {
        "value": "zhangsan" 
      }
    }
  }
}

# 响应结果
{
  "took": 0,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 1,
      "relation": "eq"
    },
    "max_score": 1.7836733,
    "hits": [
      {
        "_index": "test_query",
        "_id": "1004",
        "_score": 1.7836733,
        "_source": {
          "id": "1004",
          "name": "zhangsan",
          "age": 30
        }
      }
    ]
  }
}

对查询结果的过滤

# 对查询结果的过滤
GET test_query/_search
{
  "_source": ["name","age"]
}

# 响应结果
{
  "took": 4,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 6,
      "relation": "eq"
    },
    "max_score": 1,
    "hits": [
      {
        "_index": "test_query",
        "_id": "1001",
        "_score": 1,
        "_source": {
          "name": "zhang san",
          "age": 30
        }
      },
      {
        "_index": "test_query",
        "_id": "1002",
        "_score": 1,
        "_source": {
          "name": "li si",
          "age": 40
        }
      },
      {
        "_index": "test_query",
        "_id": "1003",
        "_score": 1,
        "_source": {
          "name": "wang wu",
          "age": 50
        }
      },
      {
        "_index": "test_query",
        "_id": "1004",
        "_score": 1,
        "_source": {
          "name": "zhangsan",
          "age": 30
        }
      },
      {
        "_index": "test_query",
        "_id": "1005",
        "_score": 1,
        "_source": {
          "name": "lisi",
          "age": 40
        }
      },
      {
        "_index": "test_query",
        "_id": "1006",
        "_score": 1,
        "_source": {
          "name": "wangwu",
          "age": 50
        }
      }
    ]
  }
}

排序

# 排序
GET test_query/_search
{
  "query": {
    "match_all": {}
  },
  "sort": [
    {
      "age": {
        "order": "desc"
      }
    }
  ]
}

# 响应结果
{
  "took": 0,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 6,
      "relation": "eq"
    },
    "max_score": null,
    "hits": [
      {
        "_index": "test_query",
        "_id": "1003",
        "_score": null,
        "_source": {
          "id": "1003",
          "name": "wang wu",
          "age": 50
        },
        "sort": [
          50
        ]
      },
      {
        "_index": "test_query",
        "_id": "1006",
        "_score": null,
        "_source": {
          "id": "1006",
          "name": "wangwu",
          "age": 50
        },
        "sort": [
          50
        ]
      },
      {
        "_index": "test_query",
        "_id": "1002",
        "_score": null,
        "_source": {
          "id": "1002",
          "name": "li si",
          "age": 40
        },
        "sort": [
          40
        ]
      },
      {
        "_index": "test_query",
        "_id": "1005",
        "_score": null,
        "_source": {
          "id": "1005",
          "name": "lisi",
          "age": 40
        },
        "sort": [
          40
        ]
      },
      {
        "_index": "test_query",
        "_id": "1001",
        "_score": null,
        "_source": {
          "id": "1001",
          "name": "zhang san",
          "age": 30
        },
        "sort": [
          30
        ]
      },
      {
        "_index": "test_query",
        "_id": "1004",
        "_score": null,
        "_source": {
          "id": "1004",
          "name": "zhangsan",
          "age": 30
        },
        "sort": [
          30
        ]
      }
    ]
  }
}

组合查询

# 组合查询 or
GET test_query/_search
{
  "query":{
    "bool": {
      "should": [
        {
          "match": {
            "name": "zhang"
          }
        },
        {
          "match": {
            "age": 40
          }
        }
      ]
    }
  }
}

# 响应结果
{
  "took": 0,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 3,
      "relation": "eq"
    },
    "max_score": 1.3555918,
    "hits": [
      {
        "_index": "test_query",
        "_id": "1001",
        "_score": 1.3555918,
        "_source": {
          "id": "1001",
          "name": "zhang san",
          "age": 30
        }
      },
      {
        "_index": "test_query",
        "_id": "1002",
        "_score": 1,
        "_source": {
          "id": "1002",
          "name": "li si",
          "age": 40
        }
      },
      {
        "_index": "test_query",
        "_id": "1005",
        "_score": 1,
        "_source": {
          "id": "1005",
          "name": "lisi",
          "age": 40
        }
      }
    ]
  }
}

显示原始数据的分组查询

# 分组查询
GET test_query/_search
{
  "aggs": {
    "ageGroup": {
      "terms": {
        "field": "age"
      }
    }
  }
}

# 响应结果
{
  "took": 10,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 6,
      "relation": "eq"
    },
    "max_score": 1,
    "hits": [
      {
        "_index": "test_query",
        "_id": "1001",
        "_score": 1,
        "_source": {
          "id": "1001",
          "name": "zhang san",
          "age": 30
        }
      },
      {
        "_index": "test_query",
        "_id": "1002",
        "_score": 1,
        "_source": {
          "id": "1002",
          "name": "li si",
          "age": 40
        }
      },
      {
        "_index": "test_query",
        "_id": "1003",
        "_score": 1,
        "_source": {
          "id": "1003",
          "name": "wang wu",
          "age": 50
        }
      },
      {
        "_index": "test_query",
        "_id": "1004",
        "_score": 1,
        "_source": {
          "id": "1004",
          "name": "zhangsan",
          "age": 30
        }
      },
      {
        "_index": "test_query",
        "_id": "1005",
        "_score": 1,
        "_source": {
          "id": "1005",
          "name": "lisi",
          "age": 40
        }
      },
      {
        "_index": "test_query",
        "_id": "1006",
        "_score": 1,
        "_source": {
          "id": "1006",
          "name": "wangwu",
          "age": 50
        }
      }
    ]
  },
  "aggregations": {
    "ageGroup": {
      "doc_count_error_upper_bound": 0,
      "sum_other_doc_count": 0,
      "buckets": [
        {
          "key": 30,
          "doc_count": 2
        },
        {
          "key": 40,
          "doc_count": 2
        },
        {
          "key": 50,
          "doc_count": 2
        }
      ]
    }
  }
}

不显示原始数据，只显示聚合结果

#不显示原始数据，只显示聚合结果
GET test_query/_search
{
  "aggs": {
    "ageGroup": {
      "terms": {
        "field": "age"
      }
    }
  },
  "size": 0
}

# 响应结果
{
  "took": 1,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 6,
      "relation": "eq"
    },
    "max_score": null,
    "hits": []
  },
  "aggregations": {
    "ageGroup": {
      "doc_count_error_upper_bound": 0,
      "sum_other_doc_count": 0,
      "buckets": [
        {
          "key": 30,
          "doc_count": 2
        },
        {
          "key": 40,
          "doc_count": 2
        },
        {
          "key": 50,
          "doc_count": 2
        }
      ]
    }
  }
}

分组之后求和

# 分组之后求和
GET test_query/_search
{
  "aggs": {
    "ageGroup": {
      "terms": {
        "field": "age"
      },
      "aggs": {
        "ageSum": {
          "sum": {
            "field": "age"
          }
        }
      }
    }
  },
  "size": 0
}

# 响应结果
{
  "took": 4,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 6,
      "relation": "eq"
    },
    "max_score": null,
    "hits": []
  },
  "aggregations": {
    "ageGroup": {
      "doc_count_error_upper_bound": 0,
      "sum_other_doc_count": 0,
      "buckets": [
        {
          "key": 30,
          "doc_count": 2,
          "ageSum": {
            "value": 60
          }
        },
        {
          "key": 40,
          "doc_count": 2,
          "ageSum": {
            "value": 80
          }
        },
        {
          "key": 50,
          "doc_count": 2,
          "ageSum": {
            "value": 100
          }
        }
      ]
    }
  }
}

求平均值

# 求平均值
GET test_query/_search
{
  "aggs": {
    "ageAvg": {
      "avg": {
        "field": "age"
      }
    }
  },
  "size": 0
}

# 响应结果
{
  "took": 0,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 6,
      "relation": "eq"
    },
    "max_score": null,
    "hits": []
  },
  "aggregations": {
    "ageAvg": {
      "value": 40
    }
  }
}

取前3名

# 取前3名
GET test_query/_search
{
  "aggs": {
    "top3": {
      "top_hits": {
        "size": 3
      }
    }
  },
  "size": 0
}

# 响应结果
{
  "took": 5,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 6,
      "relation": "eq"
    },
    "max_score": null,
    "hits": []
  },
  "aggregations": {
    "top3": {
      "hits": {
        "total": {
          "value": 6,
          "relation": "eq"
        },
        "max_score": 1,
        "hits": [
          {
            "_index": "test_query",
            "_id": "1001",
            "_score": 1,
            "_source": {
              "id": "1001",
              "name": "zhang san",
              "age": 30
            }
          },
          {
            "_index": "test_query",
            "_id": "1002",
            "_score": 1,
            "_source": {
              "id": "1002",
              "name": "li si",
              "age": 40
            }
          },
          {
            "_index": "test_query",
            "_id": "1003",
            "_score": 1,
            "_source": {
              "id": "1003",
              "name": "wang wu",
              "age": 50
            }
          }
        ]
      }
    }
  }
}

根据年龄排序取前3名

# 根据年龄排序取前3名
GET test_query/_search
{
  "aggs": {
    "ageTop3": {
      "top_hits": {
        "sort": [
          {
            "age":{
              "order": "desc"
            }
          }
        ], 
        "size": 3
      }
    }
  },
  "size": 0
}

# 响应结果
{
  "took": 16,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 6,
      "relation": "eq"
    },
    "max_score": null,
    "hits": []
  },
  "aggregations": {
    "ageTop3": {
      "hits": {
        "total": {
          "value": 6,
          "relation": "eq"
        },
        "max_score": null,
        "hits": [
          {
            "_index": "test_query",
            "_id": "1003",
            "_score": null,
            "_source": {
              "id": "1003",
              "name": "wang wu",
              "age": 50
            },
            "sort": [
              50
            ]
          },
          {
            "_index": "test_query",
            "_id": "1006",
            "_score": null,
            "_source": {
              "id": "1006",
              "name": "wangwu",
              "age": 50
            },
            "sort": [
              50
            ]
          },
          {
            "_index": "test_query",
            "_id": "1002",
            "_score": null,
            "_source": {
              "id": "1002",
              "name": "li si",
              "age": 40
            },
            "sort": [
              40
            ]
          }
        ]
      }
    }
  }
}

分词

# 分词
GET _analyze
{
  "analyzer":"ik_max_word",
  "text":["你好中国人"]
}

# 响应结果
{
  "tokens": [
    {
      "token": "你好",
      "start_offset": 0,
      "end_offset": 2,
      "type": "CN_WORD",
      "position": 0
    },
    {
      "token": "中国人",
      "start_offset": 2,
      "end_offset": 5,
      "type": "CN_WORD",
      "position": 1
    },
    {
      "token": "中国",
      "start_offset": 2,
      "end_offset": 4,
      "type": "CN_WORD",
      "position": 2
    },
    {
      "token": "国人",
      "start_offset": 3,
      "end_offset": 5,
      "type": "CN_WORD",
      "position": 3
    }
  ]
}

Ming__GoGo
关注
  • 3
    点赞
  • 踩
  • 1
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论
专栏目录
最新版linux elasticsearch-8.10.2-linux-x86-64.tar.gz
09-23
最新版linux elasticsearch-8.10.2-linux-x86_64.tar.gz最新版linux elasticsearch-8.10.2-linux-x86_64.tar.gz最新版linux elasticsearch-8.10.2-linux-x86_64.tar.gz最新版linux elasticsearch-8.10.2-linux-x86_64.tar.gz
Elasticsearch8 常用查询
llc的博客
07-06 1186
_source excludes 排除返回字段，sort时间倒序排序，from size分页
【ElasticSearch8】springboot整合es8（一），实现简单查询
热门推荐
qq_24473507的博客
04-02 1万+
ES8官方api资料不全，es7以后就不支持template的连接方式，自己踩了不少坑，这里参考官方的api做了一个demo，供各位大佬参考，有哪里不对的欢迎各路大神批评指正
ElasticSearch（八）【过滤查询】
Vinjcent
09-18 722
它 （查询）默认会计算每个返回文档的得分，然后根据得分排序。而过滤（filter）只会筛选出符合的文档，并不计算得分，而且它可以缓存文档。所以，单从性能考虑，过滤比查询更快。类型，过滤存在指定字段，获取字段不为空的索引记录使用。类型，过滤含有指定字段的索引记录。过滤(filter)
ElasticSearch（8）其他查询（脚本）：这个是重点
учёба
12-27 1422
matchAll查询 matchAll查询:查询所有文档 语法： GET 索引名称/_search{ "query":{ "match_all":{} } } 查询出来的结果，默认情况下，es一次展示10条数据 但是一般通过from和size来控制分页 { "took" : 0, //时间，第一次执行比较慢，后面就会越来越快，因为执行的结果会缓存到内存里面去 "timed_out" : false,//超时没有 "_shards" : {//分片信息，集群。。 "
ElasticSearch 学习笔记 - 8. 查询
weixin_34352005的博客
10-10 107
1、概念 映射（Mapping）描述数据在每个字段内如何存储 分析（Analysis） 全文是如何处理使之可以被搜索的 领域特定查询语言（Query DSL） Elasticsearch 中强大灵活的查询语言 2、空搜索 GET /_search { "hits" : { "total" : 14, ...
ElasticSearch笔记系列（8）——简单查询、条件查询、聚合查询
weixin_34205826的博客
04-20 443
2019独角兽企业重金招聘Python工程师标准>>> ...
java使用elasticsearch分组进行聚合查询过程解析
08-25
主要介绍了java使用elasticsearch分组进行聚合查询过程解析,文中通过示例代码介绍的非常详细，对大家的学习或者工作具有一定的参考学习价值,需要的朋友可以参考下
elasticsearch-analysis-ik-8.10.2 版本
11-01
elasticsearch-analysis-ik-8.10.2 版本基于 elasticsearch-analysis-ik-8.10.4 版本进行构建，适应于 docker elasticsearch-8.10.2 版本
最新版windows elasticsearch-8.10.2-windows-x86-64.zip
09-23
最新版windows elasticsearch-8.10.2-windows-x86_64.zip最新版windows elasticsearch-8.10.2-windows-x86_64.zip最新版windows elasticsearch-8.10.2-windows-x86_64.zip
Elasticsearch高级聚合查询
09-22
代码示例
elasticsearch8的整体总结
weixin_73195042的博客
01-25 1820
elasticsearch的总结
Elasticsearch教程(8) Query DSL 查询教程
Java Spring Elasticsearch
02-27 3215
Elasticsearch Index API
Elasticsearch官方已支持SQL查询，用起来贼方便！
macrozheng的专栏
11-30 1万+
平时使用Elasticsearch的时候，偶尔会在Kibana中使用Query DSL来查询数据。每次要用到Query DSL时都基本忘光了，需要重新在回顾一遍，最近发现Elastics...
es索引同步
yusheng_xyb的博客
05-18 267
使用MQ的优势是代码解耦，但是需要处理消息可靠性的问题有一定的技术成本，做到消息可靠性需要做到生产者投递成功、消息持久化以及消费者消费成功三个方面，另外还要做好消息幂等性问题。通过向索引中添加文章信息最终实现了课 程的搜索，我们发现文章信息是先保存在关系数据库中，而后再写入索引，这个过程是将关系数据中的数据同步到elasticsearch索引中的过程，可以简单成为索引同步。为了避免重复索引已经存在且未更新的数据，可以使用增量同步策略，仅同步新增和更新的数据，同时删除已经被标记删除的数据。
【微服务全家桶】-实用篇-4.1-ES-上篇
bblb的博客
05-17 774
【微服务全家桶】-实用篇-4.1-ES-上篇
Kubernates-dashbord-安装
最新发布
麦田里的守望者-蒋中洲【相信相信的力量】
05-21 71
kubernets 仪表盘安装，辅助故障排查
git 拉取指定目录
持 开源思想，撰 必胜所学，望 勤学者，无难处
05-15 422
以拉取github中 fastjson 的 /src/test/java/oracle/sql/ 目录为例。知道了这些，你也可以手动去修改配置信息来完成，这个就由读者自己完成吧。文件sparse-checkout 和 内容，都是由指令4完成。打开 git 自带的Git Bash 工具。橙色由指令2和3添加上去。
es 聚合查询排除null_elasticsearch 聚合查询篇
06-02
好的，针对您的问题，您可以使用 Elasticsearch 的聚合查询中的“missing”聚合来排除 null 值。 具体来说，您可以使用以下的聚合查询语句： ``` { "aggs": { "field_name": { "missing": { "field": "your_...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

Ming__GoGo

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值