Elasticsearch简单学习6:入门学习-3-CSDN博客

一、多字段特性以及配置自定义Analyzer

1.多字段类型

2.Exact Values & Full Text

3.Exact Values 不需要被分词

4.自定义分词

5.Character Filters

6.Tokenizer

7.Token Filters


##使用keyword的tokenizer以及html字符过滤器
POST _analyze
{
  "tokenizer":"keyword",
  "char_filter":["html_strip"],
  "text": "<b>hello world</b>"
}

## 使用path_hierarchy的tokenizer
POST _analyze
{
  "tokenizer":"path_hierarchy",
  "text":"/user/local/a/b/c/d/e"
}

#使用char Filter进行替换
POST _analyze
{
  "tokenizer": "standard",
  "char_filter": [
      {
        "type" : "mapping",
        "mappings" : [ "- => _"]
      }
    ],
  "text": "123-456, I-test! test-990 650-555-1234"
}


#char filter 替换表情符号
POST _analyze
{
  "tokenizer": "standard",
  "char_filter": [
      {
        "type" : "mapping",
        "mappings" : [ ":) => happy", ":( => sad"]
      }
    ],
    "text": ["I am felling :)", "Feeling :( today"]
}

###whitespace与stop
GET _analyze
{
  "tokenizer": "whitespace",
  "filter": ["stop"],
  "text": ["The rain in Spain falls mainly on the plain."]
}

##remove 加入lowercase后，The被当成 stopword删除
GET _analyze
{
  "tokenizer": "whitespace",
  "filter": ["lowercase","stop"],
  "text": ["The girls in China are playing this game!"]
}

//正则表达式
GET _analyze
{
  "tokenizer": "standard",
  "char_filter": [
      {
        "type" : "pattern_replace",
        "pattern" : "http://(.*)",
        "replacement" : "$1"
      }
    ],
    "text" : "http://www.elastic.co"
}


#创建索引时，自定义analyzer和filter
PUT my_index
{
  "settings": {
    "analysis": {
      "analyzer": {
        "my_custom_analyzer" : {
          "type": "custom",
          "char_filter":[
            "emoticons" 
          ],
          "tokenizer":"punctuation",
          "filter":[
            "lowercase",
            "english_stop"
          ]
        }
      },
      "tokenizer": {
        "punctuation": {
          "type" : "pattern",
          "pattern" : "[ .,!?]"//有个空格
        }
      },
      "char_filter": {
        "emoticons": {
          "type" : "mapping",
          "mappings" : [ ":) => _happy_", ":( => _sad_"]
        }
      },
      "filter": {
        "english_stop" : {
          "type" : "stop",
          "stopwords" : "_english_"
        }
      }
    }
  }
}

#测试一下
POST my_index/_analyze 
{
  "analyzer": "my_custom_analyzer",
  "text" : "I'm a :) person , and you ?"
}

二、Index Template和Dynamic Template

管理很多的索引时比较有用！！

1.什么是Index Template?

date_detection，设置为false,字符串日期类型会被解释为字符串。

numeric_detection , 设置为true,字符串的数字类型，会被解释为number类型。

2.Index Template的工作方式

####数字字符串被映射成text ,日期字符串被映射成日期
PUT ttemplate/_doc/1
{
	"someNumber":"1",
	"someDate":"2019/01/01"
}

## 查看映射
GET ttemplate/_mapping


################## 创建一个默认的template ##########
#Create a default template
PUT _template/template_default
{
  "index_patterns": ["*"],
  "order" : 0,
  "version": 1,
  "settings": {
    "number_of_shards": 1,
    "number_of_replicas":1
  }
}

#以test开头的索引使用的模板
PUT /_template/template_test
{
    "index_patterns" : ["test*"],
    "order" : 1,
    "settings" : {
    	"number_of_shards": 1,
        "number_of_replicas" : 2
    },
    "mappings" : {
    	"date_detection": false,
    	"numeric_detection": true
    }
}

#查看template信息
GET /_template/template_default
GET /_template/template_test
GET /_template/temp*

#写入新的数据，index以test开头 ,someNumber为Long ,someDate为text类型
PUT testtemplate/_doc/1
{
	"someNumber":"1",
	"someDate":"2019/01/01"
}

##查看发现，someNumber为Long ,someDate为text类型
GET testtemplate/_mapping
GET testtemplate/_settings

############### 给某个索引定义setting后,以这次为准######
PUT testmy
{
	"settings":{
		"number_of_replicas":5
	}
}

#插入测试数据
put testmy/_doc/1
{
  "key":"value"
}

#查看testmy索引的setting
GET testmy/_settings

DELETE testmy
DELETE /_template/template_default
DELETE /_template/template_test

3.什么是Dynamic Template?

############################# #Dynaminc Mapping 根据类型和字段名 #############
DELETE my_index

##插入一条测试数据,可以发现firstName和isVip都会被映射成text
PUT my_index/_doc/1
{
  "firstName":"Han",
  "isVIP":"true"
}

GET my_index/_mapping
DELETE my_index

######## 自定义映射关系
PUT my_index
{
  "mappings": {
    "dynamic_templates": [
            {
        "strings_as_boolean": {
          "match_mapping_type":   "string",
          "match":"is*",
          "mapping": {
            "type": "boolean"
          }
        }
      },
      {
        "strings_as_keywords": {
          "match_mapping_type":   "string",
          "mapping": {
            "type": "keyword"
          }
        }
      }
    ]
  }
}

##重新插入测试数据,可以发现firstName被映射成text,isVip被映射成boolean
PUT my_index/_doc/1
{
  "firstName":"Han",
  "isVIP":"true"
}

GET my_index/_mapping
DELETE my_index

######################结合路径 ##############
PUT my_index
{
  "mappings": {
    "dynamic_templates": [
      {
        "full_name": {
          "path_match":   "name.*",
          "path_unmatch": "*.middle",
          "mapping": {
            "type":       "text",
            "copy_to":    "full_name"
          }
        }
      }
    ]
  }
}

##插入测试数据
PUT my_index/_doc/1
{
  "name": {
    "first":  "John",
    "middle": "Winston",
    "last":   "Lennon"
  }
}

##测试一下查询
GET my_index/_search?q=full_name:John

Index Templates :https://www.elastic.co/guide/en/elasticsearch/reference/7.1/indices-templates.html

Dynamic Template : https://www.elastic.co/guide/en/elasticsearch/reference/7.1/dynamic-mapping.html

三、Elasticsearch聚合分析简介

1.什么是聚合(Aggregation)?

2.集合的分类

3.Bucket & Metric

4.Bucket

5.Metric

+++++++++++++++++++++++++++++++++++++++++++

6.一个Bucket的例子

注意：size应该设置为0，否则会返回查询结果。

7.加入Metrics

8.嵌套



#按照目的地进行分桶统计
GET kibana_sample_data_flights/_search
{
	"size": 0,
	"aggs":{
		"flight_dest":{
			"terms":{
				"field":"DestCountry"
			}
		}
	}
}

#查看航班目的地的统计信息，增加平均，最高最低价格
GET kibana_sample_data_flights/_search
{
	"size": 0,
	"aggs":{
		"flight_dest":{
			"terms":{
				"field":"DestCountry"
			},
			"aggs":{
				"avg_price":{
					"avg":{
						"field":"AvgTicketPrice"
					}
				},
				"max_price":{
					"max":{
						"field":"AvgTicketPrice"
					}
				},
				"min_price":{
					"min":{
						"field":"AvgTicketPrice"
					}
				}
			}
		}
	}
}


#价格统计信息+天气信息 ，注意使用了stats
GET kibana_sample_data_flights/_search
{
	"size": 0,
	"aggs":{
		"flight_dest":{
			"terms":{
				"field":"DestCountry"
			},
			"aggs":{
				"stats_price":{
					"stats":{
						"field":"AvgTicketPrice"
					}
				},
				"wather":{
				  "terms": {
				    "field": "DestWeather",
				    "size": 5
				  }
				}

			}
		}
	}
}

文档：https://www.elastic.co/guide/en/elasticsearch/reference/7.1/search-aggregations.html

转载于:https://my.oschina.net/hanchao/blog/3080191