Kibana+ElasticSearch实现索引数据的几种查询方式

最新推荐文章于 2024-08-22 09:36:12 发布
最新推荐文章于 2024-08-22 09:36:12 发布
阅读量1.6w 收藏 16
点赞数 5
分类专栏： 全文检索相关 文章标签： elasticsearch 大数据 对象 编程 并发
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/linhaiyun_ytdx/article/details/79762926
版权

 1.match_all搜索,直接返回所有文档

GET /school/_search
{
  "query": {
    "match_all": {
      
    }
  }
}

 返回结果大致如下: 

{
  "took": 13,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 23,
    "max_score": 1,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "b3ffcWIB-npqvsX5SmVm",
        "_score": 1,
        "_source": {
          "aggs": {
            "group_by_word_count": {
              "terms": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "c3fjcWIB-npqvsX5G2Wh",
        "_score": 1,
        "_source": {
          "aggs": {
            "grades_word_count": {
              "stats": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dHfjcWIB-npqvsX5uWWr",
        "_score": 1,
        "_source": {
          "aggs": {
            "grades_word_count": {
              "min": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dXfkcWIB-npqvsX5hmWx",
        "_score": 1,
        "_source": {
          "query": {
            "match": {
              "name": "海哥"
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dnflcWIB-npqvsX5S2V0",
        "_score": 1,
        "_source": {
          "query": {
            "multi_match": {
              "query": "海哥",
              "fields": [
                "name",
                "address"
              ]
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fXfqcWIB-npqvsX5yGXf",
        "_score": 1,
        "_source": {
          "query": {
            "bool": {
              "filter": {
                "term": {
                  "word_count": 2000
                }
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fnfrcWIB-npqvsX5mGXq",
        "_score": 1,
        "_source": {
          "query": {
            "constant_score": {
              "filter": {
                "match": {
                  "title": "ElasticSearch"
                }
              },
              "boost": 2
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "gHfucWIB-npqvsX5HWUB",
        "_score": 1,
        "_source": {
          "query": {
            "bool": {
              "must_not": [
                {
                  "term": {
                    "word_count": "2000"
                  }
                }
              ]
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 1,
        "_source": {
          "name": "张小花",
          "address": "山东烟台",
          "age": 24,
          "date": "1996-07-24"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "cHffcWIB-npqvsX59mXN",
        "_score": 1,
        "_source": {
          "aggs": {
            "group_by_word_count": {
              "terms": {
                "field": "word_count"
              }
            }
          }
        }
      }
    ]
  }
}

 参数大致解释:

  • took: 执行搜索耗时，毫秒为单位
  • time_out: 搜索是否超时
  • _shards: 多少分片被搜索，成功多少，失败多少
  • hits： 搜索结果展示
  • hits.total: 匹配条件的文档总数
  • hits.hits: 返回结果展示，默认返回十个
  • hits.max_score：最大匹配得分
  • hits._score: 返回文档的匹配得分（得分越高，匹配程度越高，越靠前）
  • _index _type _id 作为剥层定位到特定的文档

  • _source 文档源

 2.执行查询

   2.1 只显示name和address

POST /school/_search
{
  "query": { "match_all": {} },
  "_source": ["name", "address"]
}

  查询结果:

{
  "took": 313,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 23,
    "max_score": 1,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "b3ffcWIB-npqvsX5SmVm",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "c3fjcWIB-npqvsX5G2Wh",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dHfjcWIB-npqvsX5uWWr",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dXfkcWIB-npqvsX5hmWx",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dnflcWIB-npqvsX5S2V0",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fXfqcWIB-npqvsX5yGXf",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fnfrcWIB-npqvsX5mGXq",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "gHfucWIB-npqvsX5HWUB",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 1,
        "_source": {
          "address": "山东烟台",
          "name": "张小花"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "cHffcWIB-npqvsX59mXN",
        "_score": 1,
        "_source": {}
      }
    ]
  }
}

 2.2 返回name为haige的document 

POST /school/_search
{
  "query": { "match": { "name": "张小花" } }
}
  查询结果: 

{
  "took": 439,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 2,
    "max_score": 2.634553,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "bXfXcWIB-npqvsX5w2Vc",
        "_score": 2.634553,
        "_source": {
          "name": "张小花",
          "address": "山东烟台",
          "age": 24,
          "date": "1996-07-24"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 0.8630463,
        "_source": {
          "name": "张小花",
          "address": "山东烟台",
          "age": 24,
          "date": "1996-07-24"
        }
      }
    ]
  }
}

 2.3 返回name包含"海"的所有document 

POST /school/_search
{
  "query": { "match": { "name": "海" } }
}

  查询结果: 

{
  "took": 68,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 1,
    "max_score": 1.0417081,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "3",
        "_score": 1.0417081,
        "_source": {
          "name": "海哥",
          "address": "山东济宁",
          "age": 27,
          "date": "1998-03-16"
        }
      }
    ]
  }
}

  2.4 返回name中包含term "海" 或 "花" 的所有document 

POST /school/_search
{
  "query": { "match": { "name": "海 花" } }
}

{
  "took": 26,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 3,
    "max_score": 1.0417081,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "3",
        "_score": 1.0417081,
        "_source": {
          "name": "海哥",
          "address": "山东济宁",
          "age": 27,
          "date": "1998-03-16"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "bXfXcWIB-npqvsX5w2Vc",
        "_score": 0.8781843,
        "_source": {
          "name": "张小花",
          "address": "山东烟台",
          "age": 24,
          "date": "1996-07-24"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 0.2876821,
        "_source": {
          "name": "张小花",
          "address": "山东烟台",
          "age": 24,
          "date": "1996-07-24"
        }
      }
    ]
  }
}


  2.5 匹配phrase "海 花" 

POST /school/_search
{
 "query": { "match_phrase": { "name": "海 花" }}
}

  查询结果: 

{
  "took": 5,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 0,
    "max_score": null,
    "hits": []
  }
}

  2.6 返回name中包含"海"和"哥"的所有账户(AND) 

POST /school/_search
{
  "query": {
    "bool": {
      "must": [
        { "match": { "name": "海" } },
        { "match": { "name": "哥" } }
      ]
    }
  }
}

  查询结果: 

{
  "took": 208,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 1,
    "max_score": 2.0834162,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "3",
        "_score": 2.0834162,
        "_source": {
          "name": "海哥",
          "address": "山东济宁",
          "age": 27,
          "date": "1998-03-16"
        }
      }
    ]
  }
}

 2.7 返回name中包含"海"或"花"的所有document 

POST /school/_search
{
  "query": {
    "bool": {
      "should": [
        { "match": { "name": "海" } },
        { "match": { "name": "花" } }
      ]
    }
  }
}

  查询结果: 

{
  "took": 19,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 3,
    "max_score": 1.0417081,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "3",
        "_score": 1.0417081,
        "_source": {
          "name": "海哥",
          "address": "山东济宁",
          "age": 27,
          "date": "1998-03-16"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "bXfXcWIB-npqvsX5w2Vc",
        "_score": 0.8781843,
        "_source": {
          "name": "张小花",
          "address": "山东烟台",
          "age": 24,
          "date": "1996-07-24"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 0.2876821,
        "_source": {
          "name": "张小花",
          "address": "山东烟台",
          "age": 24,
          "date": "1996-07-24"
        }
      }
    ]
  }
}

  2.8 查询name中既不包含"海",也不包含"哥"的所有document 

POST /school/_search
{
  "query": {
    "bool": {
      "must_not": [
        { "match": { "name": "海" } },
        { "match": { "name": "哥" } }
      ]
    }
  }
}

 查询结果: 

{
  "took": 264,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 22,
    "max_score": 1,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "b3ffcWIB-npqvsX5SmVm",
        "_score": 1,
        "_source": {
          "aggs": {
            "group_by_word_count": {
              "terms": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "c3fjcWIB-npqvsX5G2Wh",
        "_score": 1,
        "_source": {
          "aggs": {
            "grades_word_count": {
              "stats": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dHfjcWIB-npqvsX5uWWr",
        "_score": 1,
        "_source": {
          "aggs": {
            "grades_word_count": {
              "min": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dXfkcWIB-npqvsX5hmWx",
        "_score": 1,
        "_source": {
          "query": {
            "match": {
              "name": "海哥"
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dnflcWIB-npqvsX5S2V0",
        "_score": 1,
        "_source": {
          "query": {
            "multi_match": {
              "query": "海哥",
              "fields": [
                "name",
                "address"
              ]
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fXfqcWIB-npqvsX5yGXf",
        "_score": 1,
        "_source": {
          "query": {
            "bool": {
              "filter": {
                "term": {
                  "word_count": 2000
                }
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fnfrcWIB-npqvsX5mGXq",
        "_score": 1,
        "_source": {
          "query": {
            "constant_score": {
              "filter": {
                "match": {
                  "title": "ElasticSearch"
                }
              },
              "boost": 2
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "gHfucWIB-npqvsX5HWUB",
        "_score": 1,
        "_source": {
          "query": {
            "bool": {
              "must_not": [
                {
                  "term": {
                    "word_count": "2000"
                  }
                }
              ]
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 1,
        "_source": {
          "name": "张小花",
          "address": "山东烟台",
          "age": 24,
          "date": "1996-07-24"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "cHffcWIB-npqvsX59mXN",
        "_score": 1,
        "_source": {
          "aggs": {
            "group_by_word_count": {
              "terms": {
                "field": "word_count"
              }
            }
          }
        }
      }
    ]
  }
}

 2.9 返回name中包含"海",且地址不是"山东烟台"的所有document 

POST /school/_search
{
  "query": {
    "bool": {
      "must": [
        { "match": { "name": "海" } }
      ],
      "must_not": [
        { "match": { "address": "山东烟台" } }
      ]
    }
  }
}

 查询结果: 

{
  "took": 73,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 1,
    "max_score": 1.0417081,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "3",
        "_score": 1.0417081,
        "_source": {
          "name": "海哥",
          "address": "山东济宁",
          "age": 27,
          "date": "1998-03-16"
        }
      }
    ]
  }
}

 3. 过滤查询

     3.1 在所有document中寻找age在0-25岁之间(闭区间)的学生

POST /school/_search
{
  "query": {
    "filtered": {
      "query": { "match_all": {} },
      "filter": {
        "range": {
          "age": {
            "gte": 0,
            "lte": 25
          }
        }
      }
    }
  }
}

4.谈论query和filter的效率

   一般认为filter的速度快于query的速度 
   - filter不会计算相关度得分，效率高 
   - filter的结果可以缓存到内存中，方便再用


潇潇雨歇_
关注
专栏目录
Kibana索引模式数据搜索
江晓龙的博客
07-19 1868
kibana7.9版本相较于7.6版本已经有了很大的变化。
springboot 实现elasticsearch索引数据迁移
congge
01-08 7254
springboot实现es数据迁移
Elasticsearch-通过Kibana查看索引数据
weixin_33719619的博客
10-10 1万+
引言   当数据存储到Elasticsearch后，我们希望能方便的通过界面进行查询，有两个工具能够满足我们的需要，一个是Elasticsearch-head插件，另一个是Kibana，笔者认为两个工具各有千秋，大家可以自行体会，不过就安装步骤来说，Elasticsearch-head真心麻烦，本文主要介绍...
利用Kibana来查看和管理Elasticsearch的索引
热门推荐
RisenWang 的博客
11-03 1万+
利用Kibana来查看和管理Elasticsearch的索引
在Kibana中查询使用条件ES索引数据
最新发布
zmm0420的专栏
08-22 442
3、4|6|14|TEST|ZP|383622912970719232|2023-02 是对应索引属性的值。1、dailyOrder-4-2023是索引名。4、size是查询的记录数。2、id 是索引的属性名。
Kibana对索引库的操作(3)
有趣的灵魂万里挑一,好看的皮囊你又没有
07-06 420
Kibana对索引库的基本查询操作
集群部署Elasticsearch+Logstash+Kibana+Filebeat+Kafka+Zookeeper
Wan_JF的博客
12-01 514
目录 引言 一、安装Zookeeper步骤 1、准备阶段（全部节点操作，以node1为例） （1）关闭防火墙和系统安全机制（全部节点操作，以node1为例） （2）同步时钟源（全部节点操作，以node1为例） （3）JDK的安装（全部节点操作，以node1为例） （4）配置hosts（全部节点操作，以node1为例） 2、安装Zookeeper软件包（全部节点操作，以node1为例） 3、修改配置文件（全部节点操作，以node1为例） 4、创建数据目录和日志目录（全部节点操作，以node
ElasticSearch学习笔记(一)倒排索引、ES和Kibana安装、索引操作
挑灯日记 记录自己
06-20 1169
为此，IK分词器提供了强大的停用词功能，让我们在索引时就直接忽略停用词汇表中的内容。但根据关键词查询时，必须先逐条获取每个文档，然后判断文档中是否包含所需要的关键词，是。倒排索引结构虽然不复杂，但是一旦数据结构改变（比如改变了分词器），就需要重新创建倒排索引，这又是无法接受的。先查询倒排索引，再查询倒排索引，但是无论是词条、还是文档id都建立了索引，查询速度非常快，而无需全表扫描。但由于网络问题，拉取失败了。则相反，是先找到用户要搜索的词条，根据词条得到保存词条的文档的id，然后根据id获取文档，是。
Centos7+Elasticsearch7.4.2+Kibana+IK分词+ElasticHD 安装配置以及集群搭建
Nica9799的博客
12-11 1213
Centos7+Elasticsearch7.4.2+Kibana 安装配置以及集群搭建elasticSearch 7.4.2 安装关于jdk安装ES集群的搭建配置文件合理的创建标题，有助于目录的生成如何改变文本的样式如何插入一段漂亮的代码片生成一个适合你的列表创建一个表格设定内容居中、居左、居右SmartyPants创建一个自定义列表如何创建一个注脚注释也是必不可少的KaTeX数学公式新的甘特图...
【ELK企业级日志分析系统】部署Filebeat+Kafka+Logstash+Elasticsearch+Kibana集群详解（EFLFK）
陌上花开，静待绽放！
07-13 1608
需做白日梦。你要清楚地知道你到底是谁，要去哪里。要成为一个什么样的人，很多人浑浑噩噩，得过且过。你能清楚地意识到，或者梦想去到达彼岸，有时候，人生境遇就是如此，轻而易举滴到达你的彼岸。
kibana查看和展示es数据（index pattern、discover、dashboard）
分享式获得也是一种学习的态度
10-20 1万+
每个人都有惰性，但不断学习是好好生活的根本，共勉！
ElasticSearch 索引查询使用指南——详细版
weixin_30892889的博客
09-01 5160
　　 我们通常用用_cat API检测集群是否健康。 确保9200端口号可用: 　　curl 'localhost:9200/_cat/health?v' 　　绿色表示一切正常, 黄色表示所有的数据可用但是部分副本还没有分配,红色表示部分数据因为某些原因不可用. 　...
Elasticsearch 使用kibana 查询索引数据
山水的博客
03-05 1万+
首先保证索引里面有数据，我查资料说是kibana 是用时间筛选数据的，所以必须保证类型属性里面必须有一个date时间格式的属性。但是新版的可以不用时间来检索。有一个选项。下面截图 然后创建索引模式： 选择已有的索引名称匹配，然后下一步 可以选择已有的时间属性作为检索条件，还可以选择不使用时间检索。 创建完成就可以在discover界面选择索引模式来查看数据了 ...
Elasticsearch(二)kibana数据检索
qq_42583549的博客
09-03 1270
有了数据学习使用kibana调用api检索数据，熟练kibana操作后再进一步使用spring data。termmatch文档内容格式参考。
kibana操作elasticsearch：查看索引库数据
学亮编程手记
02-26 4356
Kibana实现ElasticSearch 索引数据的增删改查
笨笨熊咦
02-14 7171
1. Kibana 的版本 服务器安装的ElasticSearch 和Kibana 的版本均为 6.5.4 2. Kibana 操作命令 2.1 索引的查询语句(简单的查询) 查询 所有索引的所有数据，执行命令： GET _search { "query": { "match_all": {} } } 2.查询指定索引goods的所有数据，执行命令： GET /good...
Kibana Discover数据查询
大叶子不小的博客
10-20 627
进入Discover页面，默认展示的索引数据不一定是我们想看的数据，可以点击change切换到kibana_sample_data_flig* 索引模式，如下图。
kibana 操作elasticsearch索引
congge_study的博客
11-24 8628
kibana 操作es索引
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

潇潇雨歇_

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值