elasticsearch Bucket & Metric 聚合分析及嵌套聚合

最新推荐文章于 2024-09-03 19:19:41 发布

树叶要走风怎么挽留

最新推荐文章于 2024-09-03 19:19:41 发布

阅读量369

点赞数

分类专栏： elasticsearch 技术使用总结 elasticsearch练习文章标签： elasticsearch

本文链接：https://blog.csdn.net/weixin_44993313/article/details/106795257

版权

技术使用总结同时被 3 个专栏收录

102 篇文章 0 订阅

订阅专栏

elasticsearch

48 篇文章 2 订阅

订阅专栏

elasticsearch练习

11 篇文章 0 订阅

订阅专栏

Bucket & Metric 聚合分析及嵌套聚合

DELETE /employees
PUT /employees/
{
  "mappings" : {
      "properties" : {
        "age" : {
          "type" : "integer"
        },
        "gender" : {
          "type" : "keyword"
        },
        "job" : {
          "type" : "text",
          "fields" : {
            "keyword" : {
              "type" : "keyword",
              "ignore_above" : 50
            }
          }
        },
        "name" : {
          "type" : "keyword"
        },
        "salary" : {
          "type" : "integer"
        }
      }
    }
}

PUT /employees/_bulk
{ "index" : {  "_id" : "1" } }
{ "name" : "Emma","age":32,"job":"Product Manager","gender":"female","salary":35000 }
{ "index" : {  "_id" : "2" } }
{ "name" : "Underwood","age":41,"job":"Dev Manager","gender":"male","salary": 50000}
{ "index" : {  "_id" : "3" } }
{ "name" : "Tran","age":25,"job":"Web Designer","gender":"male","salary":18000 }
{ "index" : {  "_id" : "4" } }
{ "name" : "Rivera","age":26,"job":"Web Designer","gender":"female","salary": 22000}
{ "index" : {  "_id" : "5" } }
{ "name" : "Rose","age":25,"job":"QA","gender":"female","salary":18000 }
{ "index" : {  "_id" : "6" } }
{ "name" : "Lucy","age":31,"job":"QA","gender":"female","salary": 25000}
{ "index" : {  "_id" : "7" } }
{ "name" : "Byrd","age":27,"job":"QA","gender":"male","salary":20000 }
{ "index" : {  "_id" : "8" } }
{ "name" : "Foster","age":27,"job":"Java Programmer","gender":"male","salary": 20000}
{ "index" : {  "_id" : "9" } }
{ "name" : "Gregory","age":32,"job":"Java Programmer","gender":"male","salary":22000 }
{ "index" : {  "_id" : "10" } }
{ "name" : "Bryant","age":20,"job":"Java Programmer","gender":"male","salary": 9000}
{ "index" : {  "_id" : "11" } }
{ "name" : "Jenny","age":36,"job":"Java Programmer","gender":"female","salary":38000 }
{ "index" : {  "_id" : "12" } }
{ "name" : "Mcdonald","age":31,"job":"Java Programmer","gender":"male","salary": 32000}
{ "index" : {  "_id" : "13" } }
{ "name" : "Jonthna","age":30,"job":"Java Programmer","gender":"female","salary":30000 }
{ "index" : {  "_id" : "14" } }
{ "name" : "Marshall","age":32,"job":"Javascript Programmer","gender":"male","salary": 25000}
{ "index" : {  "_id" : "15" } }
{ "name" : "King","age":33,"job":"Java Programmer","gender":"male","salary":28000 }
{ "index" : {  "_id" : "16" } }
{ "name" : "Mccarthy","age":21,"job":"Javascript Programmer","gender":"male","salary": 16000}
{ "index" : {  "_id" : "17" } }
{ "name" : "Goodwin","age":25,"job":"Javascript Programmer","gender":"male","salary": 16000}
{ "index" : {  "_id" : "18" } }
{ "name" : "Catherine","age":29,"job":"Javascript Programmer","gender":"female","salary": 20000}
{ "index" : {  "_id" : "19" } }
{ "name" : "Boone","age":30,"job":"DBA","gender":"male","salary": 30000}
{ "index" : {  "_id" : "20" } }
{ "name" : "Kathy","age":29,"job":"DBA","gender":"female","salary": 20000}

找到工资最低的

GET employees/_search
{
  "size": 0,
  "aggs": {
    "min_salary": {
      "min": {
        "field": "salary"
      }
    }
  }
}

找到工资最高的

POST employees/_search
{
  "size": 0
  , "aggs": {
    "max_salaryE": {
      "max": {
        "field": "salary"
      }
    }
  }
}

同时找到工资最高的和最低的

POST employees/_search
{
  "size": 0,
  "aggs": {
    "min_salary": {
      "min": {
        "field": "salary"
      }
    },
    "max_salary": {
      "max": {
        "field": "salary"
      }
    }
  }
}

一个聚合，输出多值

POST employees/_search
{
  "size": 0, 
  "aggs": {
    "stats_salary": {
      "stats": {
        "field": "salary"
      }
    }
  }
}


#Terms Aggregation
#● 字段需要打开 fielddata，才能进⾏ Terms #Aggregation
#● Keyword 默认⽀持 doc_values
#● Text 需要在 Mapping 中 #enable。会按照分词后的结果进⾏分
#● Demo
#● 对 job 和 job.keyword 进⾏聚合
#● 对性别进⾏ Terms 聚合
#● 指定 bucket size

keyword字段进行聚合

POST employees/_search
{
  "size": 0,
  "aggs": {
    "jobs": {
      "terms": {
        "field": "job.keyword"
      }
    }
  }
}

text不能直接进行terms聚合查询，因为会进行分词，会失败

POST employees/_search
{
  "size": 0,
  "aggs": {
    "jobs": {
      "terms": {
        "field": "job"
      }
    }
  }
}

text 打开fielddata，支持terms aggregation

PUT employees/_mapping
{
  "properties": {
    "job":{
      "type": "text",
      "fielddata": true
    }
  }
}

cardinality

类似于sql中的distinct

POST employees/_search
{
  "size": 0,
  "aggs": {
    "cardinate": {
      "cardinality": {
        "field": "job.keyword"
      }
    }
  }
}

###Bucket Size & Top Hits Demo
###● 应⽤场景：当获取分桶后，桶内最匹配的顶部⽂档列表
###● Size：按年龄分桶，找出指定数据量的分桶信息
###● Top Hits：查看各个⼯种中，年纪最⼤的 3 名员⼯

POST employees/_search
{
  "size": 0,
  "aggs": {
    "ages_top3": {
      "terms": {
        "field": "age",
        "size": 3
      }
    }
  }
}

指定size，不同工种中，年纪最大的三个员工的具体信息

POST employees/_search
{
  "size": 0,
  "aggs": {
    "jobs": {
      "terms": {
        "field": "job.keyword"
      },
      "aggs": {
        "old_employee": {
          "top_hits": {
            "size": 3,
            "sort": [
              {
                "age": {
                  "order": "desc"
                }
              }
            ]
          }
        }
      }
    }
  }
}

salary ranges 分桶可以自己定义 key

POST movies/_search
{
  "size": 0,
  "aggs": {
    "salary_range": {
      "range": {
        "field":"salary",
        "ranges":[
          {
            "to":10000
          },
          {
            "from":10000,
            "to":20000
          },
          {
            "key":">20000",
            "from":20000
          }
        ]
      }
    }
  }
}

salary histogram 工资0到10万，以5000一个区间进行分桶

POST employees/_search
{
  "size": 0,
  "aggs": {
    "salary_histrogram": {
      "histogram": {
        "field": "salary",
        "interval": 5000,
        "extended_bounds": {
          "min": 0,
          "max": 100000
        }
      }
    }
  }
}

嵌套聚合1，按照工作类型分桶，并统计工资信息

POST employees/_search
{
  "size": 0,
  "aggs": {
    "job_salary_stats": {
      "terms": {
        "field": "job.keyword",
        "size": 10
      },
      "aggs": {
        "salary": {
          "stats": {
            "field": "salary"
          }
        }
      }
    }
  }
}

多次嵌套，根据工作类型分桶，然后按照性别分桶，计算工资的统计信息

POST employees/_search
{
“size”: 0,
“aggs”: {
“job_gender_stats”: {
“terms”: {
“field”: “job.keyword”
},
“aggs”: {
“gender”: {
“terms”: {
“field”: “gender”
},
“aggs”: {
“stats”: {
“stats”: {
“field”: “salary”
}
}
}
}
}
}
}
}