Elasticsearch
Elasticsearch 是基于 JSON 的分布式搜索和分析引擎,专为实现水平扩展、高可用和管理便捷性而设计。
安装了Java环境
java -version
echo $JAVA_HOME
安装运行
curl -L -O https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.0.0.tar.gz
tar -xvf elasticsearch-6.0.0.tar.gz
cd elasticsearch-6.0.0/bin
./elasticsearch
测试
{
"name" : "CDNxg5-",
"cluster_name" : "elasticsearch",
"cluster_uuid" : "Ff8M_w2xQKCHdKRNn_ZuCw",
"version" : {
"number" : "6.0.0",
"build_hash" : "8f0685b",
"build_date" : "2017-11-10T18:41:22.859Z",
"build_snapshot" : false,
"lucene_version" : "7.0.1",
"minimum_wire_compatibility_version" : "5.6.0",
"minimum_index_compatibility_version" : "5.0.0"
},
"tagline" : "You Know, for Search"
}
有类似上面信息,说明安装成功。
安装分词
./bin/elasticsearch-plugin install https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v6.0.0/elasticsearch-analysis-ik-6.0.0.zip
测试分词(kibana Dev Tools下)
PUT /index
POST /index/fulltext/_mapping
{
"properties": {
"content": {
"type": "text",
"analyzer": "ik_max_word",
"search_analyzer": "ik_max_word"
}
}
}
POST /index/fulltext/1
{"content":"美国留给伊拉克的是个烂摊子吗"}
POST /index/fulltext/2
{"content":"公安部:各地校车将享最高路权"}
POST /index/fulltext/3
{"content":"中韩渔警冲突调查:韩警平均每天扣1艘中国渔船"}
POST /index/fulltext/4
{"content":"中国驻洛杉矶领事馆遭亚裔男子枪击 嫌犯已自首"}
POST /index/fulltext/_search
{
"query" : { "match" : { "content" : "中国" }},
"highlight" : {
"pre_tags" : ["<tag1>", "<tag2>"],
"post_tags" : ["</tag1>", "</tag2>"],
"fields" : {
"content" : {}
}
}
}
kibana
Kibana 能够以图表的形式呈现数据,并且具有可扩展的用户界面,供您全方位配置和管理 Elastic Stack。
安装运行
wget https://artifacts.elastic.co/downloads/kibana/kibana-6.0.0-linux-x86_64.tar.gz
sha1sum kibana-6.0.0-linux-x86_64.tar.gz
tar -xzf kibana-6.0.0-linux-x86_64.tar.gz
cd kibana-6.0.0-linux-x86_64/
./bin/kibana
ES下安装并运行x-pack
X-Pack 是集成了多种便捷功能的单个插件 — security、alerting、monitoring、reporting、graph 探索和 machine learning — 您可以在 Elastic Stack 中放心地使用这些功能。
了解详情
bin/elasticsearch-plugin install x-pack
bin/elasticsearch
生成ES密码
bin/x-pack/setup-passwords auto
Changed password for user kibana
PASSWORD kibana = oq^B-q+1234+s+Ffz0A0
Changed password for user logstash_system
PASSWORD logstash_system = HY$$^7b!1234!hN
Changed password for user elastic
PASSWORD elastic = *cn94mJ?1234~@1=
在kibana安装x-pack
bin/kibana-plugin install x-pack
修改kibana.yml
elasticsearch.username: "kibana"
elasticsearch.password: "oq^B-q+1234+s+Ffz0A0"
启动kibana
bin/kibana
logstash
Logstash 是动态数据收集管道,拥有可扩展的插件生态系统,能够与 Elasticsearch 产生强大的协同作用。
了解详情
安装logstash
wget https://artifacts.elastic.co/downloads/logstash/logstash-6.0.0.tar.gz
tar -zxvf logstash-6.0.0.tar.gz
配置logstash
安装配置x-pack
bin/logstash-plugin install x-pack
修改config/logstash.yml
xpack.monitoring.elasticsearch.username: logstash_system
xpack.monitoring.elasticsearch.password: HY$$^7b!1234!hN
一个简单的输入输出
mypipeline.conf
input { stdin { type => stdin } }
output { stdout { codec => rubydebug } }
启动logstash
bin/logstash -f mypipeline.conf