elasticsearch结构化查询(二)

已于 2023-06-03 23:19:42 修改
阅读量211 收藏
点赞数 1
分类专栏： elasticsearch 文章标签： elasticsearch lucene java
于 2023-05-14 23:55:15 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/xiezuozhen/article/details/130675031
版权

在上一篇中主要讲述了term相关的查询，以及range查询和exists查询。这一篇将会把剩余的主要的是模糊查询的学习一下。

Prefix查询

Prefix查询即前缀查询，匹配文档，字段包含拥有特定前缀的索引词(不分词)。前缀查询对应Lucene中的PrefixQuery。
如下代码所示:
查询email前缀中包含hatt的。

GET bank/_search
{
  "query": {
    "prefix": {
      "email": {
        "value": "hatt"
      }
    }
  },
      "profile": "true"
}

返回结果:

{
  "took" : 13,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 1,
      "relation" : "eq"
    },
    "max_score" : 1.0,
    "hits" : [
      {
        "_index" : "bank",
        "_type" : "account",
        "_id" : "6",
        "_score" : 1.0,
        "_source" : {
          "account_number" : 6,
          "balance" : 5686,
          "firstname" : "Hattie",
          "lastname" : "Bond",
          "age" : 36,
          "gender" : "M",
          "address" : "671 Bristol Street",
          "employer" : "Netagy",
          "email" : "hattiebond@netagy.com",
          "city" : "Dante",
          "state" : "TN"
        }
      }
    ]
  },
  "profile" : {
    "shards" : [
      {
        "id" : "[pgvIy_S0QwiNETOTSEWFtw][bank][0]",
        "searches" : [
          {
            "query" : [
              {
                "type" : "MultiTermQueryConstantScoreWrapper",
                "description" : "email:hatt*",
                "time_in_nanos" : 2344350,
                "breakdown" : {
                  "set_min_competitive_score_count" : 0,
                  "match_count" : 0,
                  "shallow_advance_count" : 0,
                  "set_min_competitive_score" : 0,
                  "next_doc" : 1888,
                  "match" : 0,
                  "next_doc_count" : 1,
                  "score_count" : 1,
                  "compute_max_score_count" : 0,
                  "compute_max_score" : 0,
                  "advance" : 2649,
                  "advance_count" : 1,
                  "score" : 1217,
                  "build_scorer_count" : 3,
                  "create_weight" : 7285,
                  "shallow_advance" : 0,
                  "create_weight_count" : 1,
                  "build_scorer" : 2331311
                }
              },
              {
                "type" : "TermQuery",
                "description" : "email:hattiebond",
                "time_in_nanos" : 325372,
                "breakdown" : {
                  "set_min_competitive_score_count" : 0,
                  "match_count" : 0,
                  "shallow_advance_count" : 0,
                  "set_min_competitive_score" : 0,
                  "next_doc" : 495,
                  "match" : 0,
                  "next_doc_count" : 1,
                  "score_count" : 0,
                  "compute_max_score_count" : 0,
                  "compute_max_score" : 0,
                  "advance" : 1077,
                  "advance_count" : 1,
                  "score" : 0,
                  "build_scorer_count" : 2,
                  "create_weight" : 41312,
                  "shallow_advance" : 0,
                  "create_weight_count" : 1,
                  "build_scorer" : 282488
                }
              },
              {
                "type" : "MatchNoDocsQuery",
                "description" : """MatchNoDocsQuery("empty BooleanQuery")""",
                "time_in_nanos" : 1590,
                "breakdown" : {
                  "set_min_competitive_score_count" : 0,
                  "match_count" : 0,
                  "shallow_advance_count" : 0,
                  "set_min_competitive_score" : 0,
                  "next_doc" : 0,
                  "match" : 0,
                  "next_doc_count" : 0,
                  "score_count" : 0,
                  "compute_max_score_count" : 0,
                  "compute_max_score" : 0,
                  "advance" : 0,
                  "advance_count" : 0,
                  "score" : 0,
                  "build_scorer_count" : 1,
                  "create_weight" : 1121,
                  "shallow_advance" : 0,
                  "create_weight_count" : 1,
                  "build_scorer" : 469
                }
              }
            ],
            "rewrite_time" : 32110,
            "collector" : [
              {
                "name" : "SimpleTopScoreDocCollector",
                "reason" : "search_top_hits",
                "time_in_nanos" : 27544
              }
            ]
          }
        ],
        "aggregations" : [ ]
      }
    ]
  }
}

Wildcard查询

Wildcard查询就是通配符查询，匹配文档，字段匹配通配符表达式(不分词)，通配符*匹配任意字符(包含空字符)。通配符?匹配任何单个字符。注意这个查询会比较缓慢，需要在许多索引词上重复执行，为了避免极端缓慢的通配符查询，通配符索引词不应该以一个通配符开头，通配符查询对应lucene中的WildCardQuery:

GET bank/_search
{
  "query": {
    "wildcard": {
      "email": {
        "value": "hat*bond"
      }
    }
  },
      "profile": "true"
}

返回结果:

{
  "took" : 4,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 1,
      "relation" : "eq"
    },
    "max_score" : 1.0,
    "hits" : [
      {
        "_index" : "bank",
        "_type" : "account",
        "_id" : "6",
        "_score" : 1.0,
        "_source" : {
          "account_number" : 6,
          "balance" : 5686,
          "firstname" : "Hattie",
          "lastname" : "Bond",
          "age" : 36,
          "gender" : "M",
          "address" : "671 Bristol Street",
          "employer" : "Netagy",
          "email" : "hattiebond@netagy.com",
          "city" : "Dante",
          "state" : "TN"
        }
      }
    ]
  },
  "profile" : {
    "shards" : [
      {
        "id" : "[pgvIy_S0QwiNETOTSEWFtw][bank][0]",
        "searches" : [
          {
            "query" : [
              {
                "type" : "MultiTermQueryConstantScoreWrapper",
                "description" : "email:hat*bond",
                "time_in_nanos" : 173122,
                "breakdown" : {
                  "set_min_competitive_score_count" : 0,
                  "match_count" : 0,
                  "shallow_advance_count" : 0,
                  "set_min_competitive_score" : 0,
                  "next_doc" : 1524,
                  "match" : 0,
                  "next_doc_count" : 1,
                  "score_count" : 1,
                  "compute_max_score_count" : 0,
                  "compute_max_score" : 0,
                  "advance" : 2187,
                  "advance_count" : 1,
                  "score" : 443,
                  "build_scorer_count" : 3,
                  "create_weight" : 8189,
                  "shallow_advance" : 0,
                  "create_weight_count" : 1,
                  "build_scorer" : 160779
                }
              },
              {
                "type" : "TermQuery",
                "description" : "email:hattiebond",
                "time_in_nanos" : 18279,
                "breakdown" : {
                  "set_min_competitive_score_count" : 0,
                  "match_count" : 0,
                  "shallow_advance_count" : 0,
                  "set_min_competitive_score" : 0,
                  "next_doc" : 492,
                  "match" : 0,
                  "next_doc_count" : 1,
                  "score_count" : 0,
                  "compute_max_score_count" : 0,
                  "compute_max_score" : 0,
                  "advance" : 984,
                  "advance_count" : 1,
                  "score" : 0,
                  "build_scorer_count" : 2,
                  "create_weight" : 9017,
                  "shallow_advance" : 0,
                  "create_weight_count" : 1,
                  "build_scorer" : 7786
                }
              },
              {
                "type" : "MatchNoDocsQuery",
                "description" : """MatchNoDocsQuery("empty BooleanQuery")""",
                "time_in_nanos" : 2172,
                "breakdown" : {
                  "set_min_competitive_score_count" : 0,
                  "match_count" : 0,
                  "shallow_advance_count" : 0,
                  "set_min_competitive_score" : 0,
                  "next_doc" : 0,
                  "match" : 0,
                  "next_doc_count" : 0,
                  "score_count" : 0,
                  "compute_max_score_count" : 0,
                  "compute_max_score" : 0,
                  "advance" : 0,
                  "advance_count" : 0,
                  "score" : 0,
                  "build_scorer_count" : 1,
                  "create_weight" : 1742,
                  "shallow_advance" : 0,
                  "create_weight_count" : 1,
                  "build_scorer" : 430
                }
              }
            ],
            "rewrite_time" : 6978,
            "collector" : [
              {
                "name" : "SimpleTopScoreDocCollector",
                "reason" : "search_top_hits",
                "time_in_nanos" : 8325
              }
            ]
          }
        ],
        "aggregations" : [ ]
      }
    ]
  }
}

Regexp查询

Regexp查询即正则查询，切记不分词的字符匹配，不然会返回为空。

GET bank/_search
{
  "query": {
    "regexp": {
      "email": "hattie.*"
    }
  },
      "profile": "true"
}

返回结果:

{
  "took" : 2,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 1,
      "relation" : "eq"
    },
    "max_score" : 1.0,
    "hits" : [
      {
        "_index" : "bank",
        "_type" : "account",
        "_id" : "6",
        "_score" : 1.0,
        "_source" : {
          "account_number" : 6,
          "balance" : 5686,
          "firstname" : "Hattie",
          "lastname" : "Bond",
          "age" : 36,
          "gender" : "M",
          "address" : "671 Bristol Street",
          "employer" : "Netagy",
          "email" : "hattiebond@netagy.com",
          "city" : "Dante",
          "state" : "TN"
        }
      }
    ]
  },
  "profile" : {
    "shards" : [
      {
        "id" : "[pgvIy_S0QwiNETOTSEWFtw][bank][0]",
        "searches" : [
          {
            "query" : [
              {
                "type" : "MultiTermQueryConstantScoreWrapper",
                "description" : "email:/hattie.*/",
                "time_in_nanos" : 130438,
                "breakdown" : {
                  "set_min_competitive_score_count" : 0,
                  "match_count" : 0,
                  "shallow_advance_count" : 0,
                  "set_min_competitive_score" : 0,
                  "next_doc" : 588,
                  "match" : 0,
                  "next_doc_count" : 1,
                  "score_count" : 1,
                  "compute_max_score_count" : 0,
                  "compute_max_score" : 0,
                  "advance" : 1144,
                  "advance_count" : 1,
                  "score" : 487,
                  "build_scorer_count" : 3,
                  "create_weight" : 1909,
                  "shallow_advance" : 0,
                  "create_weight_count" : 1,
                  "build_scorer" : 126310
                }
              },
              {
                "type" : "TermQuery",
                "description" : "email:hattiebond",
                "time_in_nanos" : 16071,
                "breakdown" : {
                  "set_min_competitive_score_count" : 0,
                  "match_count" : 0,
                  "shallow_advance_count" : 0,
                  "set_min_competitive_score" : 0,
                  "next_doc" : 313,
                  "match" : 0,
                  "next_doc_count" : 1,
                  "score_count" : 0,
                  "compute_max_score_count" : 0,
                  "compute_max_score" : 0,
                  "advance" : 599,
                  "advance_count" : 1,
                  "score" : 0,
                  "build_scorer_count" : 2,
                  "create_weight" : 8629,
                  "shallow_advance" : 0,
                  "create_weight_count" : 1,
                  "build_scorer" : 6530
                }
              },
              {
                "type" : "MatchNoDocsQuery",
                "description" : """MatchNoDocsQuery("empty BooleanQuery")""",
                "time_in_nanos" : 1635,
                "breakdown" : {
                  "set_min_competitive_score_count" : 0,
                  "match_count" : 0,
                  "shallow_advance_count" : 0,
                  "set_min_competitive_score" : 0,
                  "next_doc" : 0,
                  "match" : 0,
                  "next_doc_count" : 0,
                  "score_count" : 0,
                  "compute_max_score_count" : 0,
                  "compute_max_score" : 0,
                  "advance" : 0,
                  "advance_count" : 0,
                  "score" : 0,
                  "build_scorer_count" : 1,
                  "create_weight" : 1307,
                  "shallow_advance" : 0,
                  "create_weight_count" : 1,
                  "build_scorer" : 328
                }
              }
            ],
            "rewrite_time" : 6807,
            "collector" : [
              {
                "name" : "SimpleTopScoreDocCollector",
                "reason" : "search_top_hits",
                "time_in_nanos" : 6617
              }
            ]
          }
        ],
        "aggregations" : [ ]
      }
    ]
  }
}

Fuzzy查询

模糊查询对于字符串型字段使用基于编辑距离的相似性，以及数字型和日期型字段的正负范围进行匹配。

字符串型字段

模糊查询基于fuzziness指定的最大编辑距离生成所有可能匹配的索引词，然后检查索引字典来找出确实存在于索引中的索引词。

GET bank/_search
{
  "query": {
    "fuzzy": {
      "email": {
        "value": "hattiebond",
        "prefix_length": 0,
        "fuzziness": 0.5
      }
    }
  }
}

其中prefix_length指的是不会被模糊化的最初的字符的数量，可以用来减少必须审查的索引词的数量，默认值为0.
fuzziness指的是最大编辑距离。即允许匹配的值与关键字之间最大的偏差。
返回结果:

{
  "took" : 5,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 1,
      "relation" : "eq"
    },
    "max_score" : 6.505616,
    "hits" : [
      {
        "_index" : "bank",
        "_type" : "account",
        "_id" : "6",
        "_score" : 6.505616,
        "_source" : {
          "account_number" : 6,
          "balance" : 5686,
          "firstname" : "Hattie",
          "lastname" : "Bond",
          "age" : 36,
          "gender" : "M",
          "address" : "671 Bristol Street",
          "employer" : "Netagy",
          "email" : "hattiebond@netagy.com",
          "city" : "Dante",
          "state" : "TN"
        }
      }
    ]
  },
  "profile" : {
    "shards" : [
      {
        "id" : "[UhzKWPIsSgi8QaaJLHVmFg][bank][0]",
        "searches" : [
          {
            "query" : [
              {
                "type" : "TermQuery",
                "description" : "email:hattiebond",
                "time_in_nanos" : 464272,
                "breakdown" : {
                  "set_min_competitive_score_count" : 0,
                  "match_count" : 0,
                  "shallow_advance_count" : 0,
                  "set_min_competitive_score" : 0,
                  "next_doc" : 1137,
                  "match" : 0,
                  "next_doc_count" : 1,
                  "score_count" : 1,
                  "compute_max_score_count" : 0,
                  "compute_max_score" : 0,
                  "advance" : 3451,
                  "advance_count" : 1,
                  "score" : 5744,
                  "build_scorer_count" : 3,
                  "create_weight" : 99058,
                  "shallow_advance" : 0,
                  "create_weight_count" : 1,
                  "build_scorer" : 354882
                }
              }
            ],
            "rewrite_time" : 291191,
            "collector" : [
              {
                "name" : "SimpleTopScoreDocCollector",
                "reason" : "search_top_hits",
                "time_in_nanos" : 24215
              }
            ]
          }
        ],
        "aggregations" : [ ]
      }
    ]
  }
}
泛舟五湖之间
关注
  • 1
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论
专栏目录
Elasticsearch 结构化查询
希望我的博客，能解决你工作中的问题
03-01 588
1）环境准备 启动Elasticsearch https://blog.csdn.net/qq_36918149/article/details/104221934 启动Kinbana https://blog.csdn.net/qq_36918149/article/details/104224625 2）什么是结构化数据？ 2）什么是结构化数据搜索？ 3）demo 演示 #结构化搜...
ElasticSearch结构化查询
职场里拉开差距的不是知识，而是认知！
07-30 6597
Elasticsearch 提供了丰富的查询过滤语句，而有一些是我们较常用到的。现在我们快速的介绍一下 这些最常用到的查询过滤语句。 term 过滤 term主要用于精确匹配哪些值，比如数字，日期，布尔值或 not_analyzed的字符串(未经分析的文本数据类型)： { "term": { "age": 26 }} { "term": { "dat
今天面试问到一个 Elasticsearch 问题，给我问懵逼了......
铭毅天下Elasticsearch
06-13 7957
1、真实面试问题死磕 Elasticsearch 技术群好友留言：2、面试官在问 Elasticsearch range 过滤时，他内心在想什么？最基础的：看你了不了解 range 查询...
ES查询知识小结
weixin_45442529的博客
05-20 9030
es的查询语法学习
elasticsearch系列四：搜索详解（搜索API、Query DSL）
weixin_33911824的博客
06-22 1322
一、搜索API   1. 搜索API 端点地址 从索引tweet里面搜索字段user为kimchy的记录 GET /twitter/_search?q=user:kimchy 从索引tweet,user里面搜索字段user为kimchy的记录 GET /twitter/tweet,user/_search?q=user:kimchy GET /kimchy,elasticsearch/_...
Elasticsearch-Kibana使用教程
SimpleSimpleSimples的博客
12-03 900
PUT /employee { "settings": { "index": { "refresh_interval": "1s", "number_of_shards": 1, "max_result_window": "10000", "number_of_replicas": 0 } }, "mappings": { "properti
ES-使用profile做性能分析
wu892355227的博客
03-04 1735
本文简绍怎么使用profile做性能分析
ES查询客户端，elasticsearch可视化工具 elasticsearch查询客户端
06-20
**Elasticsearch查询客户端与可视化工具*...总之，Elasticsearch查询客户端和可视化工具是提升ES操作效率和理解力的重要工具。正确选择和使用这些工具，能帮助开发者更好地管理和利用存储在Elasticsearch中的海量数据。
springboot+es实现对word，pdf，txt等文件的非结构化数据全文内容检索
06-11
在非结构化数据检索场景下，Elasticsearch能通过分词器对文本进行分析，建立倒排索引，从而实现快速全文搜索。 Spring Boot是基于Spring框架的轻量级开发工具，它简化了初始化、配置和运行过程。集成Elasticsearch...
elastic search 7.6.2 查询
12-21
Elasticsearch 中有多种数据类型，例如数字类型、关键字、时间类型、别名、binary、二进制、range 类型、text 类型、对象关系类型、结构化类型、特殊类型等。 数字类型包括 long、integer、short、byte、double、...
Elasticsearch查询API
10-13
【Elasticsearch查询API】是Elasticsearch中用于检索数据的核心功能，允许用户通过各种查询语句和过滤条件从索引中获取相关文档。本文将详细介绍Elasticsearch接口API的使用，特别是全文检索、查询匹配以及常用的...
elasticsearch+hbase海量数据查询
06-26
elasticsearch+hbase海量数据查询,支持千万数据秒回查询 一、ElasticSearch和Hbase ElasticSearch是一个基于Lucene的搜索服务器。它提供了一个分布式多用户能力的全文搜索引擎，基于RESTful web接口。Elasticsearch...
elasticsearch其它一下日常操作
q908544703的博客
06-01 530
查看es表结构或者索引数据(按需使用) http://59.1.6.68:19200/kcap_km_docs/type_docs/_search?pretty http://12.12.12.125:9200/km/km_docs/_search?pretty 删除es索引数据 curl -XDELETE ‘localhost:9200/km?pretty’ curl -XDELETE ‘lo...
5.Search详解
Gedeon
07-24 715
1.Search API URL Search 在URL 中使用查询参数 Request Body Search 使用Elasticsearch 提供的，基于JSON 格式的更加完备的Query Domain Specific Language (DSL) 1.1 指定查询的索引 语法 范围 /_search 集群上所有的索引 index1/_search in...
【Elasticsearch系列】elasticsearch wildcard 慢查询原因分析(深入到源码!!!)
我活在当下，我巨他妈勇敢。
09-05 743
大家好，我是蓝胖子，前段时间线上elasticsearch集群遇到多次wildcard产生的性能问题， elasticsearch wildcard 一直是容易引发elasticsearch 容易宕机的一个风险点， 但究竟它为何消耗cpu呢？又该如何理解elasticsearch profile api的返回结果呢？在探索了部分源码后，我将在这篇文章一一揭晓答案。
ES-Elasticsearch数据库查询
qq_28771987的博客
03-26 1924
ES增删改查 一：结构操作 1.查询对应索引的表结构 GET biz_commission_book 2.创建表 复制代码 PUT cfg_send_sku { “settings”: { “number_of_shards”: 5, “number_of_replicas”: 1 }, "mappings": { "cfg_send_sku" : { "properties" : { "obdCode" : {
ES—查询语法架构详解
热门推荐
不是很懂
03-11 2万+
ElasticSearch查询语句归类 背景：初学者面对ES的DSL(domain specific language)查询显得一脸懵逼，看着各种嵌套的语句不知道有什么规律，下面就给大家总结一下，方便学习理解记忆。官方的文档版本好像是2.X，ES更新很快现在都7.X，现在的很多语法和关键字都和2.x的版本不同了，甚至删除了不少关键字，随着版本越高，相应的查询语法和关键字等方方面面也逐渐稳定起来了。这里我是按照7.X版本总结的。 ...
ES基础知识和常用查询基础
weixin_38931408的博客
07-13 3845
ES基础理论和基础查询
Git 操作总结
最新发布
weixin_40134371的博客
07-03 966
Git 操作总结
es高手进阶篇笔记，136章
02-25
在Elasticsearch中，结构化搜索是一种常见的查询方式，尤其适用于处理大数据。在第002章中，通过IT技术论坛的案例，讲解了如何使用termfilter进行数据筛选。termfilter是根据确切值进行搜索的工具，支持数字、布尔值...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

泛舟五湖之间

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付：¥1
获取中
扫码支付

您的余额不足，请更换扫码支付或充值

打赏作者

实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值