常用ES命令 Demo

最新推荐文章于 2024-08-13 22:20:09 发布
最新推荐文章于 2024-08-13 22:20:09 发布
阅读量1.4k 收藏
点赞数 1
分类专栏： Java 文章标签： es命令 es
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/b2222505/article/details/86098116
版权 
push-trace-20190108/_search
{
  "query": {
    "bool": {
      "must": [
        {
          "term": {
            "event": "CONNECTOR_INSTANT_MESSAGE_DELIVER_SUCCESS"
          }
        },
        {
          "term": {
            "appId": "otzoXoBSVbhEcUxAqYNdla3X"
          }
        }
      ]
    }
  },"sort": "eventTime"
}




{
  "query": {
    "bool": {
      "must": [
        {
          "term": {
            "appId": "SB4X6n005019ejXrqYVbRh3X"
          }
        },
        {
          "term": {
            "event": "CONNECTOR_MESSAGE_DELIVER_SUCCESS"
          }
        }
      ]
    }
  },
  "size": 0,
  "aggs": {
    "uniq_attr": {
      "cardinality": {
        "field": "messageId"
      }
    }
  }
}



push_device_save_new/_search

{
  "query": {
    "bool": {
      "must": [
        {
          "terms": {
            "mcsVersion": [
              "1.0.27","1.0.28","1.0.29","1.0.32","1.2.0","1.4.0","1.4.1","1.4.3"
            ],
            "boost": 1
          }
        }
      ],
      "disable_coord": false,
      "adjust_pure_negative": true,
      "boost": 1
    }
  },
  "size": 0,
  "timeout": "120s",
  "_source": false,
  "aggregations": {
    "model": {
      "terms": {
        "field": "model",
        "size": 200,
        "min_doc_count": 1,
        "shard_min_doc_count": 0,
        "show_term_doc_count_error": false,
        "order": [
          {
            "_count": "desc"
          },
          {
            "_term": "asc"
          }
        ]
      }
    }
  }
}

index模版参数及优化

{
  "order": 0,
  "template": "connector-connection*",
  "settings": {
    "index": {
      "routing": {
        "allocation": {
          "total_shards_per_node": "5"
        }
      },
      "refresh_interval": "300s",
      "number_of_shards": "36",
      "translog": {
        "flush_threshold_size": "6GB",
        "sync_interval": "60s",
        "durability": "async"
      },
      "merge": {
        "scheduler": {
          "max_thread_count": "1"
        }
      },
      "store": {
        "throttle": {
          "max_bytes_per_sec": "200mb"
        }
      },
      "unassigned": {
        "node_left": {
          "delayed_timeout": "60m"
        }
      },
      "number_of_replicas": "1"
    }
  },
  "mappings": {
    "type_push": {
      "properties": {
        "deviceId": {
          "type": "keyword"
        },
        "eventType": {
          "type": "keyword"
        },
        "connectionTime": {
          "type": "date",
          "format": "epoch_millis"
        },
        "connectorIp": {
          "type": "ip"
        },
        "clientIndex": {
          "type": "keyword"
        },
        "mcsVersion": {
          "type": "keyword"
        },
        "networkType": {
          "type": "keyword"
        }
      }
    }
  },
  "aliases": {}
}
	
	
	

curl语句
//更新，创建模板(匹配大小写问题)
curl -H 'Content-Type:application/json' -XPUT 10.15.74.16:9200/_template/push_device_save -d '{
  "order": 0,
  "template": "push_device_save",
  "settings": {
    "index": {
      "analysis": {
        "normalizer": {
          "my_normalizer": {
            "filter": [
              "lowercase",
              "asciifolding"
            ],
            "type": "custom"
          }
        }
      },
      "number_of_shards": "9"
    }
  },
  "mappings": {
    "push_device_save": {
      "properties": {
        "id": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "imei": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "serialNumber": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "model": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "imsi": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "meid": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "ipMacAddress": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "ipv4": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "ipv6": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "wifiMacAddress": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "bluetoothMacAddress": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "androidId": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "androidVersion": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "osVersion": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "romVersion": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "mcsVersion": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "regionCode": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "otaVersion": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "language": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "operator": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "basebandVersion": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "kernelVersion": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "pcbNumber": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "brand": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "regionMark": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "persistentRegionMark": {
          "type": "keyword",
          "normalizer": "my_normalizer"
        },
        "createTime": {
          "type": "date"
        },
        "updateTime": {
          "type": "date"
        }
      }
    }
  },
  "aliases": {}
}
'

//获取模板配置
curl  -H 'Content-Type:application/json'  -XGET 10.15.74.16:9200/_template/push_device_save  

//修改批量拉取window大小
curl -H 'Content-Type:application/json' -XPUT http://10.35.208.15:9210/push_device_save/_settings -d '{ "index" : { "max_result_window" : 20000}}'
curl -H 'Content-Type:application/json' -XPUT http://10.35.208.15:9210/push_device_save_new/_search -d '{}'

//删除模板
curl -XDELETE 10.35.208.15:9210/push_device_save/push_device_save

//sroll 查询+分片slice
curl -H 'Content-Type:application/json' -X GET http://10.15.74.16:9200/_search?scroll=1m  -d '{
  "size" : 50000,
  "timeout" : "90s",
  "query" : {
    "bool" : {
      "must" : [
        {
          "terms" : {
            "androidVersion" : [
              "8.1.0"
            ],
            "boost" : 1.0
          }
        },
        {
          "terms" : {
            "model" : [
              "OPPO R11"
            ],
            "boost" : 1.0
          }
        },
        {
          "terms" : {
            "mcsVersion" : [
              "1.0.27"
            ],
            "boost" : 1.0
          }
        }
      ],
      "filter" : [
        {
          "range" : {
            "updateTime" : {
              "from" : "2019-04-28T16:00:00.000Z",
              "to" : null,
              "include_lower" : true,
              "include_upper" : true,
              "boost" : 1.0
            }
          }
        }
      ],
      "disable_coord" : false,
      "adjust_pure_negative" : true,
      "boost" : 1.0
    }
  },
  "_source":["id","imei"]
  "sort" : [
    {
      "_doc" : {
        "order" : "asc"
      }
    }
  ],
  "slice" : {
    "field" : "_uid",
    "id" : 3,
    "max" : 5
  }
}'


curl -H 'Content-Type:application/json' -X GET http://10.1.8.46:9200/push_device_save_new/_search  -d '{ "size": 0}'
curl -H 'Content-Type:application/json' -X GET http://10.1.15.43:9200/push_device_save_new/_search  -d '{ "size": 0}'

//续写scroll正确scroll 第二类：不用index了  scroll 耗时需要什么
_search/scroll  （cerebro里面不需要/开头）
{
    "scroll":"5ms",
  "scroll_id": "DnF1ZXJ5VGhlbkZldGNoCQAAAAAAfzD0FmtOc1FuSUpmUnpPVk9xYzRnU1Y5YncAAAAAAEARuRY0SXlFVU5ZQ1FJR2E1WTc2bFIxUjFRAAAAAAB_MPMWa05zUW5JSmZSek9WT3FjNGdTVjlidwAAAAAAQBG6FjRJeUVVTllDUUlHYTVZNzZsUjFSMVEAAAAAAH8w8hZrTnNRbklKZlJ6T1ZPcWM0Z1NWOWJ3AAAAAABAEbgWNEl5RVVOWUNRSUdhNVk3NmxSMVIxUQAAAAAAfzD2FmtOc1FuSUpmUnpPVk9xYzRnU1Y5YncAAAAAAEARuxY0SXlFVU5ZQ1FJR2E1WTc2bFIxUjFRAAAAAAB_MPUWa05zUW5JSmZSek9WT3FjNGdTVjlidw=="
}


控制台语句
//普通查询：综合query,filter,mustnot,source
index/_search
{
  "from": 0,
  "size": 50,
  "query": {
    "bool": {
      "must": [
        
         {
        "terms" : {
          "model" : [
            "HD1901"
          ],
          "boost" : 1.0
        }
      }
      ],
       "filter" : [
      {
        "range" : {
          "updateTime" : {
            "from" : "2019-02-13T16:00:00.000Z",
            "to" : null,
            "include_lower" : true,
            "include_upper" : true,
            "boost" : 1.0
          }
        }
      }
    ],
       "must_not" : [
      {
        "terms" : {
          "imei" : [
            "10111"
          ],
          "boost" : 1.0
        }
      }
    ]
    }
  },
  "sort": [
    {
      "_doc": {
        "order": "asc"
      }
    }
  ],
   "_source" : false
}


//es 新增 ，没有_index,type
push_device_save/create {
  "id":"1111",
  "imei":"2222"
}

//es 更新，这样覆盖全部数据
push_device_save/push_device/591bedba563569631a87980c  index/type/id
{}  直接更新数据

//es 更新，局部更新
push_device_save/push_device/591bedba563569631a87980c/_update 
{
   "doc" : {
      "imei" : "only update imei"
   }
}

//根据查询删除
push_device_save/_delete_by_query
{
  "query": {
    "bool": {
      "filter": [
        {
          "term": {
            "id": "1111"
          }
        }
      ]
    }
  }
}


//自定义标签最复杂
{
  "size": 100,
  "timeout": "20s",
  "query": {
    "bool": {
      "must": [
        {
          "bool": {
            "should": [
              {
                "terms": {
                  "imei": [
                    "22",
                    "44"
                  ]
                }
              }
            ],
            "must": [
              {
                "terms": {
                  "imei": [
                    "11"
                  ]
                }
              }
            ],
            "must_not": [
              {
                "terms": {
                  "imei": [
                    "55"
                  ]
                }
              }
            ]
          }
        }
      ]
    }
  }
}

//聚类
{
  "query": {
    "bool": {
      "must_not": [
        {
          "terms": {
            "brand": [
              "oppo",
              "realme",
              "oneplus"
            ],
            "boost": 1
          }
        }
      ],
      "disable_coord": false,
      "adjust_pure_negative": true,
      "boost": 1
    }
  },
  "size": 0,
  "timeout": "120s",
  "_source": false,
  "aggregations": {
    "model": {
      "terms": {
        "field": "model",
        "size": 200,
        "min_doc_count": 1,
        "shard_min_doc_count": 0,
        "show_term_doc_count_error": false,
        "order": [
          {
            "_count": "desc"
          },
          {
            "_term": "asc"
          }
        ]
      }
    }
  }
}



//es 删除数组操作
{
    "script" : {
        "source": "if (ctx._source.appId.contains(params.tag)) { ctx._source.appId.remove(ctx._source.appId.indexOf(params.tag)) }",
        "lang": "painless",
        "params" : {
            "tag" : "ZngnvJIM7wQusNtbqYnpH6XX"
        }
    }
}

//es 新增数组操作
{
  "script": {
    "inline": "ctx._source.imei.add(params.new_imei)",
    "params": {
      "new_imei": "11"
    }
  }
}


//根据某个字段去重
curl -H 'Content-Type:application/json' -XGET http://10.15.74.16:9200/push_device_save_new/_search -d '{
  "size":0,
  "timeout": "120s",
  "aggs":{
    "count": {
      "cardinality": {
        "field": "imei"
      }
    }
  }
}'

//根据某个字段去重
curl -H 'Content-Type:application/json' -XGET http://10.15.74.16:9200/push_device_save_new/_search -d '{
 "query": {
    "bool": {
      "must": [
        {
          "terms": {
            "mcsVersion":  [
             "2.0.0","2.0.1","2.0.2","2.0.3","2.0.4","2.0.5","2.0.6","2.0.7","2.0.8","2.0.9","2.0.10","2.1.0","2.1.1","2.1.2","2.1.3","2.1.4","2.1.5","2.1.6","2.1.7","2.1.8","2.1.9","2.1.10","2.2.0","2.2.1","2.2.2","2.2.3","2.2.4","2.2.5","2.2.6","2.2.7","2.2.8","2.2.9","2.2.10"  ],
            "boost": 1
          }
        }
      ],
       "must" : [
      {
        "terms" : {
          "language" : [
            "th"
          ],
          "boost" : 1.0
        }
      }
		],
      "disable_coord": false,
      "adjust_pure_negative": true,
      "boost": 1
    }
  },
  "size":0,
  "timeout": "120s",
  "aggs":{
    "count": {
      "cardinality": {
        "field": "DUID"
      }
    }
  }
}'


//查询条件+聚类
{
  "query": {
    "bool": {
      "must": [
        {
          "terms": {
            "model": [
              "cph1819"
            ],
            "boost": 1
          }
        },
        {
          "terms" : {
            "language" : [
              "th"
            ],
            "boost" : 1.0
          }
        }
      ],
      "disable_coord": false,
      "adjust_pure_negative": true,
      "boost": 1
    }
  },
  "size": 0,
  "timeout": "120s",
  "_source": false,
  "aggregations": {
    "model": {
      "terms": {
        "field": "mcsVersion",
        "size": 200,
        "min_doc_count": 1,
        "shard_min_doc_count": 0,
        "show_term_doc_count_error": false,
        "order": [
          {
            "_count": "desc"
          },
          {
            "_term": "asc"
          }
        ]
      }
    }
  }
}


//es update_by_query
curl -H 'Content-Type:application/json' -XPOST http://10.11.106.41:9201/push_device_save_new/_update_by_query -d '
 {
  "query": {
    "bool": {
      "filter": [
        {
          "term": {
            "model": "pclm10"
          }
        }
      ],
	    "must_not" : [
      {
        "terms" : {
          "brand" : [
            "oppo",
			 "realme",
			 "oneplus"
          ],
          "boost" : 1.0
        }
      }
    ]
    }
  },
 "script": {
    "source": "ctx._source['brand']='oppo'" 
  }
}'
啊浪的博客
关注
专栏目录
基于Elasticsearch + Fluentd + Kibana（EFK）搭建日志收集管理系统
dvlinker的技术专栏
07-01 1万+
详细讲述基于Elasticsearch、Fluentd和Kibana的日志管理系统搭建过程。
ES常用命令基础
KingWeiGG的博客
06-23 3173
ES常用命令及相关实例 ES常用命令 命令 含义 PUT 增加/跟新 UPDATE 改变 DELET 删除 GET 查询 POST 查询/修改 HEAD 改变/删除 ES数据模型 ElasticSearch 含义 Index 索引，由多个Document组成 Type 索引类型，6.x中仅支持一个，以后将逐渐被移除 Document 文档，由多个Field组成 Field 字段，包括字段名与字段值 注：一个索引只能存一个类型
ES常用操作命令
weixin_38871825的博客
12-09 3768
要创建索引，需要发送带有设置，映射和别名的PUT请求，或者仅发送不带正文的简单请求。Mget批量查询：进行查询的时候，如果一次性查询多条数据的话，采用批量操作的api，尽可能减少网络开销次数，可以将性能大幅度提升。模糊检索：模糊查询查找在模糊度中指定的最大编辑距离内的所有可能的匹配项，然后检查术语字典，以找出在索引中实际存在待检索的关键词。复合查询：这些查询是不同查询的集合，这些查询通过使用布尔运算符（例如和/或，或不）或针对不同的索引或具有函数调用等彼此合并。*查询比较慢，通常需要使用一个长的前缀。
Elasticsearch（ES）常用命令
最新发布
qq_44861892的博客
08-13 1251
es运维必备
Elasticsearch（ES）常用命令整理
一只慵懒的猫z的博客
01-21 1万+
在前几篇文章大家主要进行Elasticsearch的入门学习。接下来，本文着重介绍了Elasticsearch的常用基础命令。 1、获取es集群服务健康状态 2、查看ES中所有的索引 3、根据条件查询索引中的文档 4、查看索引的统计信息 5、新建索引 6、删除索引
ES常用命令
bo_wei的博客
09-30 9923
#查看磁盘空间 _cat/allocation?v #查看索引分片分布及分片占用存储空间大小与文档数（会扫描所有分片，慎用!!!） _cat/shards?v #查看指定索引分片分布及分片占用存储空间大小与文档数 _cat/shards/{index}?v #查看主节点是哪台机器 _cat/master?v #查看主节点CPU，内存情况 _cat/nodes?v #查看集群任务 _cat/tasks?v #查看集群所有索引列表，并展示每个索引的状态、分片数量、文档数量、索引占用存储空间大小 _cat/in.
ES 常用命令
fhzh520的专栏
08-30 214
命令说明 命令 返回信息 创建索 my_index_v1 PUT /my_index_v1 创建索引 my_index_v1，然后让别名my_index指向它 PUT /my_index_v1/_alias/my_index 请求得到别名my_index 指向的索引 ...
OpenGL ES 学习demo
12-05
6. **绘制命令**：`glDrawArrays()` 和 `glDrawElements()` 是两个常用的绘制命令，用于根据顶点数组或索引数组绘制图形，如点、线、三角形等。 现在，我们来分析一下描述中的内容：“自己学着画点，线，面”。这...
学习ElasticSearch 常用命令记录
zhanjunpeng01的博客
12-10 150
环境elasticsearch-7.4.2 + openjdk-11 自己在windows机器测试命令记录 最新文档地址： https://www.elastic.co/guide/en/elasticsearch/reference/current/search-analyze.html#search-analyze 1. 安装浏览器ElasticSearch插件（chrome）：...
docker常用命令 超详细 附带demo
haoyun的博客
12-10 448
Docker常用命令 以下使用过的命令 docker version docker info #系统信息 docker --help docker images docker pull docker rmi docker run docker ps 命令可以在docker——docs——reference 查询 镜像命令 多看官方文档命令很多，多使用 --help 来查询帮助 Commands: attach Attach local standard inp
elasticsearch painless脚本使用（附demo及painless API）
HiterCoder
12-26 2万+
Kibana 提供了一些强大的方法，用于搜索和可视化 Elasticsearch 中存储的数据。为了实现可视化，Kibana 会搜索 Elasticsearch mapping 中定义的 field，并以图表的形式将它们作为选项呈现给用户。但是，如果你忘记在 schema 中将一个重要的值定义为单独的 field 会怎么样呢？或者，如果你想把两个 field 合并到一起该怎么办呢？这时就可以使用
es常用命令
热门推荐
u011535199的博客
07-28 2万+
查询索引、数据
ES的一些常用命令
u013111855的博客
01-27 8924
自学ES常用的一些入门命令
elasticsearch客户端常用命令有哪些？
04-24
一些常用的elasticsearch客户端命令包括： 1. GET /_cluster/health：检查集群健康状况 2. PUT /my_index：创建一个新的索引 3. POST /my_index/_doc：向索引中添加一个新的文档 4. GET /my_index/_search：执行一...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值