ElasticSearch学习_陶文5_【02】把 Elasticsearch 当数据库使：过滤和排序

最新推荐文章于 2024-06-28 23:33:28 发布
最新推荐文章于 2024-06-28 23:33:28 发布
阅读量959 收藏 1
点赞数
分类专栏： ElasticSearch 转载 文章标签： elasticsearch mysql

使用 https://github.com/taowen/es-monitor 可以用 SQL 进行 elasticsearch 的查询。本章介绍简单的文档过滤条件

exchange='nyse'

SQL

$ cat << EOF | ./es_query.py http://127.0.0.1:9200
select * from symbol where exchange='nyse' limit 1
EOF
{"sector": "n/a", "_type": "symbol", "market_cap": 4469064, "name": "3D Systems Corporation", "exchange": "nyse", "symbol": "DDD", "last_sale": 807, "_index": "symbol", "ipo_year": null, "_id": "AVLqbUjEQ3iIyyVFLQgV", "industry": "Technology"}

Elasticsearch

{
  "query": {
    "term": {
      "exchange": "nyse"
    }
  }, 
  "size": 1
}
{
  "hits": {
    "hits": [
      {
        "_score": 1.728313, 
        "_type": "symbol", 
        "_id": "AVLqbUjEQ3iIyyVFLQgV", 
        "_source": {
          "sector": "n/a", 
          "market_cap": 4469064, 
          "name": "3D Systems Corporation", 
          "exchange": "nyse", 
          "symbol": "DDD", 
          "last_sale": 807, 
          "ipo_year": null, 
          "industry": "Technology"
        }, 
        "_index": "symbol"
      }
    ], 
    "total": 3240, 
    "max_score": 1.728313
  }, 
  "_shards": {
    "successful": 1, 
    "failed": 0, 
    "total": 1
  }, 
  "took": 6, 
  "timed_out": false
}

Profile

  
  

   
   <button href="javascript:void(0);" _xhe_href="javascript:void(0);" class="copyCode btn btn-xs zeroclipboard-is-hover" data-clipboard-text="" ["="" data-toggle="tooltip" data-placement="top" title="" style="color: rgb(255, 255, 255); font-family: inherit; font-size: 12px; font-style: inherit; font-variant: inherit; line-height: 1.5; margin: 0px 0px 0px 5px; overflow: visible; cursor: pointer; vertical-align: middle; border: 1px solid transparent; white-space: nowrap; padding-right: 5px; padding-left: 5px; border-top-left-radius: 3px; border-top-right-radius: 3px; border-bottom-right-radius: 3px; border-bottom-left-radius: 3px; -webkit-user-select: none; box-shadow: rgba(0, 0, 0, 0.2) 0px 1px 2px; background-color: rgba(0, 0, 0, 0.74902);">复制
   
   
  
  
[
  {
    "query": [
      {
        "query_type": "TermQuery",
        "lucene": "exchange:nyse",
        "time": "2.336230000ms",
        "breakdown": {
          "score": 470159,
          "create_weight": 417360,
          "next_doc": 786055,
          "match": 0,
          "build_scorer": 662656,
          "advance": 0
        }
      }
    ],
    "rewrite_time": 3566,
    "collector": [
      {
        "name": "SimpleTopScoreDocCollector",
        "reason": "search_top_hits",
        "time": "1.561495000ms"
      }
    ]
  }
]

exchange='nyse' AND sector='Technology'

SQL

$ cat << EOF | ./es_query.py http://127.0.0.1:9200
select * from symbol where exchange='nyse' and sector='Technology' limit 1
EOF
{"sector": "Technology", "_type": "symbol", "market_cap": 4469064, "name": "3D Systems Corporation", "exchange":"nyse", "symbol": "DDD", "last_sale": 807, "_index": "symbol", "ipo_year": null, "_id": "AVLqdtWhQ3iIyyVFLSJQ", "industry": "Computer Software: Prepackaged Software"}

Elasticsearch

{
  "query": {
    "bool": {
      "filter": [
        {
          "term": {
            "exchange": "nyse" }
        }, 
        {
          "term": {
            "sector": "Technology" }
        }
      ]
    }
  }, 
  "size": 1
}
{
  "hits": {
    "hits": [
      {
        "_score": 0.0, 
        "_type": "symbol", 
        "_id": "AVLqdtWhQ3iIyyVFLSJQ", 
        "_source": {
          "sector": "Technology", 
          "market_cap": 4469064, 
          "name": "3D Systems Corporation", 
          "exchange": "nyse", 
          "symbol": "DDD", 
          "last_sale": 807, 
          "ipo_year": null, 
          "industry": "Computer Software: Prepackaged Software"
        }, 
        "_index": "symbol"
      }
    ], 
    "total": 186, 
    "max_score": 0.0
  }, 
  "_shards": {
    "successful": 1, 
    "failed": 0, 
    "total": 1
  }, 
  "took": 5, 
  "timed_out": false
}

Profile

[
  {
    "query": [
      {
        "query_type": "BooleanQuery",
        "lucene": "#exchange:nyse #sector:Technology",
        "time": "3.999703000ms",
        "breakdown": {
          "score": 54437,
          "create_weight": 413531,
          "next_doc": 1213355,
          "match": 0,
          "build_scorer": 736504,
          "advance": 0
        },
        "children": [
          {
            "query_type": "TermQuery",
            "lucene": "exchange:nyse",
            "time": "1.175638000ms",
            "breakdown": {
              "score": 0,
              "create_weight": 186745,
              "next_doc": 0,
              "match": 0,
              "build_scorer": 616840,
              "advance": 372053
            }
          },
          {
            "query_type": "TermQuery",
            "lucene": "sector:Technology",
            "time": "0.4062380000ms",
            "breakdown": {
              "score": 0,
              "create_weight": 125321,
              "next_doc": 115632,
              "match": 0,
              "build_scorer": 45136,
              "advance": 120149
            }
          }
        ]
      }
    ],
    "rewrite_time": 23008,
    "collector": [
      {
        "name": "SimpleTopScoreDocCollector",
        "reason": "search_top_hits",
        "time": "0.1031780000ms"
      }
    ]
  }
]

last_sale > 985

SQL

$ cat << EOF | ./es_query.py http://127.0.0.1:9200
select * from symbol where last_sale > 985 limit 1
EOF
{"sector": "Finance", "_type": "symbol", "market_cap": 42010000, "name": "1347 Capital Corp.", "exchange":"nasdaq", "symbol": "TFSCU", "last_sale": 1005, "_index": "symbol", "ipo_year": 2014, "_id":"AVLqdtWdQ3iIyyVFLRZB", "industry": "Business Services"}

Elasticsearch

{
  "query": {
    "range": {
      "last_sale": {
        "gt": 985.0
      }
    }
  }, 
  "size": 1
}
{
  "hits": {
    "hits": [
      {
        "_score": 1.0, 
        "_type": "symbol", 
        "_id": "AVLqdtWdQ3iIyyVFLRZB", 
        "_source": {
          "sector": "Finance", 
          "market_cap": 42010000, 
          "name": "1347 Capital Corp.", 
          "exchange": "nasdaq", 
          "symbol": "TFSCU", 
          "last_sale": 1005, 
          "ipo_year": 2014, 
          "industry": "Business Services"
        }, 
        "_index": "symbol"
      }
    ], 
    "total": 4285, 
    "max_score": 1.0
  }, 
  "_shards": {
    "successful": 1, 
    "failed": 0, 
    "total": 1
  }, 
  "took": 2, 
  "timed_out": false
}

Profile

[
  {
    "query": [
      {
        "query_type": "MultiTermQueryConstantScoreWrapper",
        "lucene": "last_sale:{985 TO *]",
        "time": "4.684710000ms",
        "breakdown": {
          "score": 423966,
          "create_weight": 21384,
          "next_doc": 469032,
          "match": 0,
          "build_scorer": 3770328,
          "advance": 0
        }
      }
    ],
    "rewrite_time": 10493,
    "collector": [
      {
        "name": "SimpleTopScoreDocCollector",
        "reason": "search_top_hits",
        "time": "1.261998000ms"
      }
    ]
  }
]

last_sale != 985

SQL

$ cat << EOF | ./es_query.py http://127.0.0.1:9200
select * from symbol where last_sale != 985 limit 1
EOF
{"sector": "Finance", "_type": "symbol", "market_cap": null, "name": "1347 Capital Corp.", "exchange": "nasdaq", "symbol": "TFSCR", "last_sale": 16, "_index": "symbol", "ipo_year": 2014, "_id": "AVLqdtWdQ3iIyyVFLRZA", "industry": "Business Services"}

Elasticsearch

{
  "query": {
    "bool": {
      "must_not": {
        "term": {
          "last_sale": 985 }
      }
    }
  }, 
  "size": 1
}
{
  "hits": {
    "hits": [
      {
        "_score": 1.0, 
        "_type": "symbol", 
        "_id": "AVLqdtWdQ3iIyyVFLRZA", 
        "_source": {
          "sector": "Finance", 
          "market_cap": null, 
          "name": "1347 Capital Corp.", 
          "exchange": "nasdaq", 
          "symbol": "TFSCR", 
          "last_sale": 16, 
          "ipo_year": 2014, 
          "industry": "Business Services"
        }, 
        "_index": "symbol"
      }
    ], 
    "total": 6708, 
    "max_score": 1.0
  }, 
  "_shards": {
    "successful": 1, 
    "failed": 0, 
    "total": 1
  }, 
  "took": 1, 
  "timed_out": false
}

Profile

[
  {
    "query": [
      {
        "query_type": "BooleanQuery",
        "lucene": "+*:* -last_sale: Y",
        "time": "14.10871500ms",
        "breakdown": {
          "score": 3397824,
          "create_weight": 401619,
          "next_doc": 7993655,
          "match": 0,
          "build_scorer": 141022,
          "advance": 0
        },
        "children": [
          {
            "query_type": "MatchAllDocsQuery",
            "lucene": "*:*",
            "time": "1.694079000ms",
            "breakdown": {
              "score": 974401,
              "create_weight": 5175,
              "next_doc": 705676,
              "match": 0,
              "build_scorer": 8827,
              "advance": 0
            }
          },
          {
            "query_type": "TermQuery",
            "lucene": "last_sale: Y",
            "time": "0.4805160000ms",
            "breakdown": {
              "score": 0,
              "create_weight": 342905,
              "next_doc": 0,
              "match": 0,
              "build_scorer": 104919,
              "advance": 32692
            }
          }
        ]
      }
    ],
    "rewrite_time": 32619,
    "collector": [
      {
        "name": "SimpleTopScoreDocCollector",
        "reason": "search_top_hits",
        "time": "4.604778000ms"
      }
    ]
  }
]

exchange='nyse' AND NOT sector='Technology'

SQL

$ cat << EOF | ./es_query.py http://127.0.0.1:9200
select * from symbol where exchange='nyse' AND NOT sector='Technology' limit 1
EOF
{"sector": "Health Care", "_type": "symbol", "market_cap": 3865437245, "name": "3M Company", "exchange": "nyse", "symbol": "MMM", "last_sale": 15244, "_index": "symbol", "ipo_year": null, "_id": "AVLqdtWhQ3iIyyVFLSJR", "industry": "Medical/Dental Instruments"}

Elasticsearch

{
  "query": {
    "bool": {
      "filter": [
        {
          "term": {
            "exchange": "nyse" }
        }
      ], 
      "must_not": [
        {
          "term": {
            "sector": "Technology" }
        }
      ]
    }
  }, 
  "size": 1
}
{
  "hits": {
    "hits": [
      {
        "_score": 0.0, 
        "_type": "symbol", 
        "_id": "AVLqdtWhQ3iIyyVFLSJR", 
        "_source": {
          "sector": "Health Care", 
          "market_cap": 3865437245, 
          "name": "3M Company", 
          "exchange": "nyse", 
          "symbol": "MMM", 
          "last_sale": 15244, 
          "ipo_year": null, 
          "industry": "Medical/Dental Instruments"
        }, 
        "_index": "symbol"
      }
    ], 
    "total": 3054, 
    "max_score": 0.0
  }, 
  "_shards": {
    "successful": 1, 
    "failed": 0, 
    "total": 1
  }, 
  "took": 5, 
  "timed_out": false
}

Profile

[
  {
    "query": [
      {
        "query_type": "BooleanQuery",
        "lucene": "#exchange:nyse -sector:Technology",
        "time": "3.078346000ms",
        "breakdown": {
          "score": 164364,
          "create_weight": 216094,
          "next_doc": 1872817,
          "match": 0,
          "build_scorer": 114716,
          "advance": 0
        },
        "children": [
          {
            "query_type": "TermQuery",
            "lucene": "exchange:nyse",
            "time": "0.4679310000ms",
            "breakdown": {
              "score": 0,
              "create_weight": 119897,
              "next_doc": 290703,
              "match": 0,
              "build_scorer": 57331,
              "advance": 0
            }
          },
          {
            "query_type": "TermQuery",
            "lucene": "sector:Technology",
            "time": "0.2424240000ms",
            "breakdown": {
              "score": 0,
              "create_weight": 62239,
              "next_doc": 0,
              "match": 0,
              "build_scorer": 32978,
              "advance": 147207
            }
          }
        ]
      }
    ],
    "rewrite_time": 19262,
    "collector": [
      {
        "name": "SimpleTopScoreDocCollector",
        "reason": "search_top_hits",
        "time": "0.5360760000ms"
      }
    ]
  }
]

exchange='nyse' OR NOT sector='Technology'

SQL

$ cat << EOF | ./es_query.py http://127.0.0.1:9200
select * from symbol where exchange='nyse' OR NOT sector='Technology' limit 1
EOF
{"sector": "Health Care", "_type": "symbol", "market_cap": 3865437245, "name": "3M Company", "exchange": "nyse", "symbol": "MMM", "last_sale": 15244, "_index": "symbol", "ipo_year": null, "_id": "AVLqdtWhQ3iIyyVFLSJR", "industry": "Medical/Dental Instruments"}

Elasticsearch

{
  "query": {
    "bool": {
      "should": [
        {
          "term": {
            "exchange": "nyse" }
        }, 
        {
          "bool": {
            "must_not": [ { "term": { "sector": "Technology" } } ] }
        }
      ]
    }
  }, 
  "size": 1
}
{
  "hits": {
    "hits": [
      {
        "_score": 0.99838185, 
        "_type": "symbol", 
        "_id": "AVLqdtWhQ3iIyyVFLSJR", 
        "_source": {
          "sector": "Health Care", 
          "market_cap": 3865437245, 
          "name": "3M Company", 
          "exchange": "nyse", 
          "symbol": "MMM", 
          "last_sale": 15244, 
          "ipo_year": null, 
          "industry": "Medical/Dental Instruments"
        }, 
        "_index": "symbol"
      }
    ], 
    "total": 6245, 
    "max_score": 0.99838185
  }, 
  "_shards": {
    "successful": 1, 
    "failed": 0, 
    "total": 1
  }, 
  "took": 9, 
  "timed_out": false
}

Profile

[
  {
    "query": [
      {
        "query_type": "BooleanQuery",
        "lucene": "exchange:nyse (-sector:Technology +*:*)",
        "time": "21.24846700ms",
        "breakdown": {
          "score": 4197895,
          "create_weight": 815882,
          "next_doc": 5963510,
          "match": 0,
          "build_scorer": 3902610,
          "advance": 0
        },
        "children": [
          {
            "query_type": "TermQuery",
            "lucene": "exchange:nyse",
            "time": "1.099460000ms",
            "breakdown": {
              "score": 219612,
              "create_weight": 529960,
              "next_doc": 266196,
              "match": 0,
              "build_scorer": 83692,
              "advance": 0
            }
          },
          {
            "query_type": "BooleanQuery",
            "lucene": "-sector:Technology +*:*",
            "time": "5.269110000ms",
            "breakdown": {
              "score": 1221522,
              "create_weight": 209290,
              "next_doc": 1693148,
              "match": 0,
              "build_scorer": 521166,
              "advance": 0
            },
            "children": [
              {
                "query_type": "TermQuery",
                "lucene": "sector:Technology",
                "time": "0.6576720000ms",
                "breakdown": {
                  "score": 0,
                  "create_weight": 141704,
                  "next_doc": 0,
                  "match": 0,
                  "build_scorer": 274371,
                  "advance": 241597 }
              },
              {
                "query_type": "MatchAllDocsQuery",
                "lucene": "*:*",
                "time": "0.9663120000ms",
                "breakdown": {
                  "score": 441766,
                  "create_weight": 5317,
                  "next_doc": 508525,
                  "match": 0,
                  "build_scorer": 10704,
                  "advance": 0 }
              }
            ]
          }
        ]
      }
    ],
    "rewrite_time": 61389,
    "collector": [
      {
        "name": "SimpleTopScoreDocCollector",
        "reason": "search_top_hits",
        "time": "4.847758000ms"
      }
    ]
  }
]

date > now() - INTERVAL '60 DAYS'

SQL

$ cat << EOF | ./es_query.py http://127.0.0.1:9200
select * from quote where "date" > now() - interval '30 DAYS' limit 1
EOF

这个 now() 和 interval 的语法是和postgresql一致的（http://www.postgresql.org/docs/9.1/static/functions-datetime.html）

{"volume": 118900, "_type": "quote", "_index": "quote", "symbol": "AMRS", "adj_close": 147, "high": 149, "low":138, "date": "2016-02-16", "close": 147, "_id": "AMRS-2016-02-16", "open": 140}

Elasticsearch

{
  "query": {
    "range": {
      "date": {
        "gt": 1453212988000
      }
    }
  }, 
  "size": 1
}

查询是和普通的大于一样的。

symbol LIKE 'AAP%'

SQL

$ cat << EOF | ./es_query.py http://127.0.0.1:9200
select * from symbol WHERE symbol LIKE 'AAP%'
EOF
{"sector": "Technology", "_type": "symbol", "market_cap": 522690000000, "name": "Apple Inc.", "exchange": "nasdaq", "symbol": "AAPL", "last_sale": 9427, "_index": "symbol", "ipo_year": 1980, "_id": "AVL0FqFJog4u0JP7lzka", "industry": "Computer Manufacturing"}
{"sector": "Finance", "_type": "symbol", "market_cap": 105960000, "name": "Atlantic Alliance Partnership Corp.", "exchange": "nasdaq", "symbol": "AAPC", "last_sale": 1019, "_index": "symbol", "ipo_year": 2015, "_id": "AVL0FqFJog4u0JP7lzlf", "industry": "Business Services"}
{"sector": "Consumer Services", "_type": "symbol", "market_cap": 148395246, "name": "Advance Auto Parts Inc", "exchange": "nyse", "symbol": "AAP", "last_sale": 13857, "_index": "symbol", "ipo_year": null, "_id": "AVL0FqFQog4u0JP7l0R7", "industry": "Other Specialty Stores"}

Elasticsearch

{
  "query": {
    "wildcard": {
      "symbol": "AAP*"
    }
  }
}
{
  "hits": {
    "hits": [
      {
        "_score": 1.0, 
        "_type": "symbol", 
        "_id": "AVL0FqFJog4u0JP7lzka", 
        "_source": {
          "sector": "Technology", 
          "market_cap": 522690000000, 
          "name": "Apple Inc.", 
          "exchange": "nasdaq", 
          "symbol": "AAPL", 
          "last_sale": 9427, 
          "ipo_year": 1980, 
          "industry": "Computer Manufacturing"
        }, 
        "_index": "symbol"
      }, 
      {
        "_score": 1.0, 
        "_type": "symbol", 
        "_id": "AVL0FqFJog4u0JP7lzlf", 
        "_source": {
          "sector": "Finance", 
          "market_cap": 105960000, 
          "name": "Atlantic Alliance Partnership Corp.", 
          "exchange": "nasdaq", 
          "symbol": "AAPC", 
          "last_sale": 1019, 
          "ipo_year": 2015, 
          "industry": "Business Services"
        }, 
        "_index": "symbol"
      }, 
      {
        "_score": 1.0, 
        "_type": "symbol", 
        "_id": "AVL0FqFQog4u0JP7l0R7", 
        "_source": {
          "sector": "Consumer Services", 
          "market_cap": 148395246, 
          "name": "Advance Auto Parts Inc", 
          "exchange": "nyse", 
          "symbol": "AAP", 
          "last_sale": 13857, 
          "ipo_year": null, 
          "industry": "Other Specialty Stores"
        }, 
        "_index": "symbol"
      }
    ], 
    "total": 3, 
    "max_score": 1.0
  }, 
  "_shards": {
    "successful": 1, 
    "failed": 0, 
    "total": 1
  }, 
  "took": 29, 
  "timed_out": false
}

Profile

[
  {
    "query": [
      {
        "query_type": "MultiTermQueryConstantScoreWrapper",
        "lucene": "symbol:AAP*",
        "time": "5.018644000ms",
        "breakdown": {
          "score": 3186,
          "create_weight": 34308,
          "next_doc": 31760,
          "match": 0,
          "build_scorer": 4949390,
          "advance": 0
        }
      },
      {
        "query_type": "BooleanQuery",
        "lucene": "symbol:AAP symbol:AAPC symbol:AAPL",
        "time": "4.731495000ms",
        "breakdown": {
          "score": 0,
          "create_weight": 205709,
          "next_doc": 26459,
          "match": 0,
          "build_scorer": 4299185,
          "advance": 0
        },
        "children": [
          {
            "query_type": "TermQuery",
            "lucene": "symbol:AAP",
            "time": "0.09350600000ms",
            "breakdown": {
              "score": 0,
              "create_weight": 15337,
              "next_doc": 4021,
              "match": 0,
              "build_scorer": 74148,
              "advance": 0
            }
          },
          {
            "query_type": "TermQuery",
            "lucene": "symbol:AAPC",
            "time": "0.07045600000ms",
            "breakdown": {
              "score": 0,
              "create_weight": 6874,
              "next_doc": 1225,
              "match": 0,
              "build_scorer": 62357,
              "advance": 0
            }
          },
          {
            "query_type": "TermQuery",
            "lucene": "symbol:AAPL",
            "time": "0.03618000000ms",
            "breakdown": {
              "score": 0,
              "create_weight": 4934,
              "next_doc": 1253,
              "match": 0,
              "build_scorer": 29993,
              "advance": 0
            }
          }
        ]
      }
    ],
    "rewrite_time": 25703,
    "collector": [
      {
        "name": "SimpleTopScoreDocCollector",
        "reason": "search_top_hits",
        "time": "0.04072600000ms"
      }
    ]
  }
]
  }
]

从profile结果可以看出，所谓的LIKE查询，其实不是一个个去查文档。而是先从字典表里把这个字段的所有的符合LIKE条件的term查出来，然后去查满足这些term的文档。把LIKE变成一堆=条件的OR来处理的。

ORDER BY name

SQL

$ cat << EOF | ./es_query.py http://127.0.0.1:9200
select * from symbol order by name limit 1
EOF
{"sector": "n/a", "_type": "symbol", "market_cap": 72460000, "name": "iShares 0-5 Year Investment Grade Corporate Bond ETF", "exchange": "nasdaq", "symbol": "SLQD", "last_sale": 4997, "_index": "symbol", "ipo_year": null, "_id":"AVLqdtWfQ3iIyyVFLRwf", "industry": "n/a"}

Elasticsearch

{
  "sort": [
    {
      "name": "asc"
    }
  ], 
  "size": 1
}
{
  "hits": {
    "hits": [
      {
        "sort": [
          "0"
        ], 
        "_type": "symbol", 
        "_source": {
          "sector": "n/a", 
          "market_cap": 72460000, 
          "name": "iShares 0-5 Year Investment Grade Corporate Bond ETF", 
          "exchange": "nasdaq", 
          "symbol": "SLQD", 
          "last_sale": 4997, 
          "ipo_year": null, 
          "industry": "n/a"
        }, 
        "_score": null, 
        "_index": "symbol", 
        "_id": "AVLqdtWfQ3iIyyVFLRwf"
      }
    ], 
    "total": 6714, 
    "max_score": null
  }, 
  "_shards": {
    "successful": 1, 
    "failed": 0, 
    "total": 1
  }, 
  "took": 4, 
  "timed_out": false
}

Profile

[
  {
    "query": [
      {
        "query_type": "MatchAllDocsQuery",
        "lucene": "*:*",
        "time": "1.379354000ms",
        "breakdown": {
          "score": 0,
          "create_weight": 32506,
          "next_doc": 850386,
          "match": 0,
          "build_scorer": 496462,
          "advance": 0
        }
      }
    ],
    "rewrite_time": 18167,
    "collector": [
      {
        "name": "SimpleFieldCollector",
        "reason": "search_top_hits",
        "time": "1.225077000ms"
      }
    ]
  }
]


  • 原文来自：https://segmentfault.com/a/1190000004443190
Wang_Zhenwei
关注
  • 0
    点赞
  • 踩
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
elasticsearch_ES_Elasticsearch界面_elasticsearch_源码
10-04
**Elasticsearch（ES）详解** Elasticsearch是一款开源、分布式、实时的全文搜索引擎，它基于Lucene构建，被广泛用于大数据分析、日志聚合、实时搜索和索引等场景。其强大的功能和易用性使得它在IT行业中备受青睐。...
ElasticSearch中profile API的使用
不见其长，日有所长
03-29 5983
1. 前言 profile API 是 Elasticsearch 5.x 的一个新接口。通过这个功能，可以看到一个搜索聚合请求，是如何拆分成底层的 Lucene 请求，并且显示每部分的耗时情况。 2. profile API 使用 可以通过在 query 部分上方提供 “profile: true” 来启用Profile API。 GET /ljjtest/book/_search { "p...
一次 ElasticSearch 搜索优化
weixin_30628801的博客
03-20 265
一次 ElasticSearch 搜索优化 1. 环境 ES6.3.2，索引名称 user_v1，5个主分片，每个分片一个副本。分片基本都在11GB左右，GET _cat/shards/user 一共有3.4亿文档，主分片总共57GB。 Segment信息：curl -X GET "221.228.105.140:9200/_cat/segments/user_v1?v" >> u...
elasticsearch去重：collapse、cardinality、terms+top_hits实现总结
最新发布
码到三十五
06-28 1万+
灵活性：字段聚合+top_hits提供了更多的自定义选项，可以按多个字段进行分组，并控制返回的文档数量和排序。而collapse则更简单直接，只基于一个字段进行分组。性能：对于大数据集，collapse可能更高效，因为它避免了复杂的聚合计算。然而，实际性能还取决于具体的使用场景和数据分布。结果丰富性：字段聚合+top_hits可以返回更丰富的信息，包括分组大小和多个代表文档。而collapse只返回每个分组的最佳文档。在选择使用哪种方法时，应根据具体需求、数据量和性能要求来权衡。
ES慢查询分析——性能提升6 倍
Angus
12-26 2577
生产环境频繁报警。查询跨度91天的数据，请求耗时已经来到了30+s。报警的阈值为5s。经过问题排查，提供了优化方案。最后请求时间降到5s内。
max_result_window会影响es性能_Elasticsearch 最佳性能优化
weixin_42300721的博客
11-30 1313
本文转自: http://wangnan.tech/post/elkstack-es03/，作者: Ghost Stories侵删。批量提交在 CRUD 章节，我们已经知道 ES 的数据写入是如何操作的了。喜欢自己动手的读者可能已经迫不及待的自己写了程序开始往 ES 里写数据做测试。这时候大家会发现：程序的运行速度非常一般，即使 ES 服务运行在本机，一秒钟大概也就能写入几百条数据。这种...
ElastaticSearch----top_hits，es获取聚合的相关文档结果
u011250186的博客
10-10 1215
ElastaticSearch----top_hits，es获取聚合的相关文档结果
elasticsearch_exporter：Prometheus的Elasticsearch统计信息导出器
02-03
Elasticsearch导出器 Prometheus导出程序，用于以Go语言编写的有关ElasticSearch的各种指标。 安装 对于预构建的二进制文件，请查看发行版。 码头工人 docker pull justwatch/elasticsearch_exporter:1.1.0 docker...
es与solr的区别_solr_ES_es与solr的区别_elasticsearch_
10-03
在大数据和搜索引擎领域，Elasticsearch (ES) 和 Apache Solr 都是广泛使用的开源技术，它们都基于 Lucene 库，提供高性能、可扩展的全文搜索和分析能力。然而，两者在设计哲学、使用场景、功能特性以及社区支持等...
Elasticsearch5学习笔记和Java对es进行增删改查示例
01-09
**Elasticsearch 5 学习笔记** Elasticsearch 是一个开源的全文搜索引擎，它以其分布式、实时、灵活和强大的数据分析能力而广受赞誉。在版本 5 中，Elasticsearch 强化了搜索性能，优化了API，并引入了一些新特性。...
Elasticsearch服务器开发2.0 - 副本--高清版-es数据库学习.rar
07-22
Elasticsearch服务器开发2.0 高清版pdf，中文版，总共有八章
ElasticSearch 学习笔记：聚合(Aggregation) - Top Hits
热门推荐
崔显龙的博客
02-21 1万+
聚合后，每一个聚合Bucket里面仅返回指定顺序的前N条数据。
es修改排序_【02】把 Elasticsearch 当数据库使：过滤和排序
weixin_30320081的博客
12-23 373
使用 https://github.com/taowen/es-monitor 可以用 SQL 进行 elasticsearch 的查询。本章介绍简单的文档过滤条件exchange='nyse'SQL$ cat << EOF | ./es_query.py http://127.0.0.1:9200select * from symbol where exchange='nyse' l...
ElasticSearch 聚合学习（TopHits聚合使用）
鹏举的博客
07-01 8283
TopHits聚合 聚合后，每一个聚合Bucket里面仅返回指定顺序的前N条数据。 应用场景 例如可以展示出某一个网站文档浏览前N名的文档，es中储存的数据是用户每点击一次文档即浏览一次文档就会对文档进行储存 { "size": 0, // 仅过滤数据，不返回命中数据。 "query": { "bool": { "must": [ // 过滤条件，在聚合前先进行数据筛选。 { "terms": { "del"
elasticsearch：查询评分排除某些查询条件constantScoreQuery
闫玉林的博客
08-08 2286
IDF: Inverse Document Frequency缩写，表示该term在所有文档中出现的频率。TF: Term Frequency的缩写，表示该term在当前document出现的频率。
elasticsearch的重写机制
君归北阙朝天帝的博客
11-15 1961
概念 在使用前缀查询（prefix）及通配符查询（wildcard）时，本质上讲都是对多个关键词的查询；在这个概念的基础上，elasticsearch对用户的查询进行了重写（例如将前缀查询优化为should的term查询）。 目的 保证查询的性能。 例子 假定索引中有以下数据： curl -XPUT 'localhost:9200/clients/client/1' -d '{"id":"1", "name":"Joe"}' curl -XPUT 'localhost:9200/clients/clie
Elasticsearch实战（十六）---TOP N 实现统计组内排名最高的N条数据及histogram区间统计
流浪的喵的博客
07-11 2475
es搜索 实现统计组内排名最高的TopN条数据及Histogram区间统计， date_histogram日期区间统计的详细用法
(三)ElasticSearch实战基础教程(ElasticSearch入门)
张三博客
02-24 457
7. URI 详解 7.1 通过URI query 实现搜索 GET /companyinfo/_search?q=公司&df=entName&from=0&size=1&timeout=1s { "profile":"true" } q 指定查询语句,使用Query String Syntax df 默认字段，不指定时会对所有字段进行查询 Sort 排序/ from 和 size 用于分页 Profile 可以查看查询是如何被执行的 7.2 Query Stri.
es 指定排序字段_Elasticsearch：根据类型对不同字段进行排序
05-25
在Elasticsearch中，可以根据不同的字段类型进行排序。以下是一些示例： 1. 对于数字类型字段，可以使用以下命令进行排序： ``` { "sort": { "numeric_field": { "order": "asc" } } } ``` 2. 对于日期字段，可以使用以下命令进行排序： ``` { "sort": { "date_field": { "order": "desc" } } } ``` 3. 对于文本类型字段，可以使用以下命令进行排序： ``` { "sort": { "text_field.keyword": { "order": "asc" } } } ``` 在这个示例中，我们使用了 ".keyword" 后缀来指定精确匹配的文本类型字段。如果您没有使用 ".keyword" 后缀，则Elasticsearch将默认使用分析后的文本进行排序。 请注意，如果您想要同时使用多个排序字段，可以使用数组来指定它们的顺序： ``` { "sort": [ {"numeric_field": {"order": "asc"}}, {"date_field": {"order": "desc"}}, {"text_field.keyword": {"order": "asc"}} ] } ```
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值