BS问题 elasticsearch8.5.2 集群安装

已于 2022-12-18 11:36:54 修改
阅读量1.6k 收藏 1
点赞数
分类专栏： elasticsearch摸索 文章标签： elasticsearch java 大数据
于 2022-12-18 11:22:15 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/qq_30337573/article/details/128359877
版权

环境 centos7

3台虚拟机(vagrant创建的)

node1=192.168.3.51,node2=192.168.3.61,node3=192.168.3.62

第一步：下载tar.gz文件，并且解压，我的是解压到/usr/local/

#node1、node2、node3 采用安装包安装

wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-8.5.2-linux-x86_64.tar.gz
wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-8.5.2-linux-x86_64.tar.gz.sha512
shasum -a 512 -c elasticsearch-8.5.2-linux-x86_64.tar.gz.sha512   
#如果没有命令：yum install perl-Digest-SHA
tar -xzf elasticsearch-8.5.2-linux-x86_64.tar.gz
cd elasticsearch-8.5.2/

第二步：系统配置

#ElasticSearch不能以Root身份运行， node1、node2、node3需要单独创建一个用户

groupadd elsearch
useradd elsearch -g elsearch -p elasticsearch
chown -R elsearch:elsearch  /usr/local/elasticsearch-8.5.2

问题描述：后面启动的时候可能出现问题，我的出现了

max virtual memory areas vm.max_map_count [65530] is too low, increase to at least 错误信息

#修改系统配置
vi /etc/sysctl.conf

#添加
vm.max_map_count=655360

#执行生效
sysctl -p

#继续修改
vi /etc/security/limits.conf

#在文件末尾添加（注意这些带*的也要添加，我开始以为是注销的就没有添加，然后就一堆错误）
* soft nofile 65536

* hard nofile 131072

* soft nproc 2048

* hard nproc 4096

elsearch soft nproc 125535

elsearch hard nproc 125535

第二步：修改配置文件

[elsearch@worker02 config]$ pwd
/usr/local/elasticsearch-8.5.2/config
[elsearch@worker02 config]$ vim elasticsearch.yml

需要注意一点：path.data参数三个节点的目录地址设置成不一样的路径，不然启动第二个节点的时候，有错误提示，大概意思是有节点以及获取了相同路径的锁，再次获取失败

[2022-12-18T01:00:30,311][ERROR][o.e.b.Elasticsearch      ] [node-2] fatal exception while booting Elasticsearchjava.lang.IllegalStateException: failed to obtain node locks, tried [/usr/local/elasticsearch-8.5.2/data]; maybe these locations are not writable or multiple nodes were started on the same data path?
	at org.elasticsearch.server@8.5.2/org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:285)
	at org.elasticsearch.server@8.5.2/org.elasticsearch.node.Node.<init>(Node.java:474)
	at org.elasticsearch.server@8.5.2/org.elasticsearch.node.Node.<init>(Node.java:318)
	at org.elasticsearch.server@8.5.2/org.elasticsearch.bootstrap.Elasticsearch$2.<init>(Elasticsearch.java:214)
	at org.elasticsearch.server@8.5.2/org.elasticsearch.bootstrap.Elasticsearch.initPhase3(Elasticsearch.java:214)

1、node1节点

在路径：/usr/local/elasticsearch-8.5.2/需要创建data目录（名字任取，只是要和配置文件一致 path.data: /usr/local/elasticsearch-8.5.2/data）


# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#       Before you set out to tweak and tune the configuration, make sure you
#       understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: es8.5
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: node-1
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /usr/local/elasticsearch-8.5.2/data
#
# Path to log files:
#
path.logs: /usr/local/elasticsearch-8.5.2/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# By default Elasticsearch is only accessible on localhost. Set a different
# address here to expose this node on the network:
#
network.host: 192.168.3.51
#
# By default Elasticsearch listens for HTTP traffic on the first free port it
# finds starting at 9200. Set a specific HTTP port here:
#
http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
discovery.seed_hosts: ["192.168.3.51", "192.168.3.61","192.168.62"]
#
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
#
#
cluster.initial_master_nodes: ["node-1", "node-2","node-3"]
#
# For more information, consult the discovery and cluster formation module documentation.
#
# --------------------------------- Readiness ----------------------------------
#
# Enable an unauthenticated TCP readiness endpoint on localhost
#
#readiness.port: 9399
#
# ---------------------------------- Various -----------------------------------
#
# Allow wildcard deletion of indices:
#
action.destructive_requires_name: false

xpack.security.enabled: false

2、node2节点

在路径：/usr/local/elasticsearch-8.5.2/需要创建data02目录（名字任取，只是要和配置文件一致 path.data: /usr/local/elasticsearch-8.5.2/data02）

# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#       Before you set out to tweak and tune the configuration, make sure you
#       understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: es8.5
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: node-2
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /usr/local/elasticsearch-8.5.2/data02
#
# Path to log files:
#
path.logs: /usr/local/elasticsearch-8.5.2/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# By default Elasticsearch is only accessible on localhost. Set a different
# address here to expose this node on the network:
#
network.host: 192.168.3.61
#
# By default Elasticsearch listens for HTTP traffic on the first free port it
# finds starting at 9200. Set a specific HTTP port here:
#
http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
discovery.seed_hosts: ["192.168.3.51", "192.168.3.61","192.168.62"]
#
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
cluster.initial_master_nodes: ["node-1", "node-2","node-3"]
#
#
# For more information, consult the discovery and cluster formation module documentation.
#
# --------------------------------- Readiness ----------------------------------
#
# Enable an unauthenticated TCP readiness endpoint on localhost
#
#readiness.port: 9399
#
# ---------------------------------- Various -----------------------------------
#
# Allow wildcard deletion of indices:
#
action.destructive_requires_name: false


xpack.security.enabled: false

3、node3

在路径：/usr/local/elasticsearch-8.5.2/需要创建data03目录（名字任取，只是要和配置文件一致 path.data: /usr/local/elasticsearch-8.5.2/data03）

# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#       Before you set out to tweak and tune the configuration, make sure you
#       understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: es8.5
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: node-3
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /usr/local/elasticsearch-8.5.2/data03
#
# Path to log files:
#
path.logs: /usr/local/elasticsearch-8.5.2/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# By default Elasticsearch is only accessible on localhost. Set a different
# address here to expose this node on the network:
#
network.host: 192.168.3.62
#
# By default Elasticsearch listens for HTTP traffic on the first free port it
# finds starting at 9200. Set a specific HTTP port here:
#
http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
discovery.seed_hosts: ["192.168.3.51", "192.168.3.61","192.168.62"]
#
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
cluster.initial_master_nodes: ["node-1", "node-2","node-3"]
#
#
# For more information, consult the discovery and cluster formation module documentation.
#
# --------------------------------- Readiness ----------------------------------
#
# Enable an unauthenticated TCP readiness endpoint on localhost
#
#readiness.port: 9399
#
# ---------------------------------- Various -----------------------------------
#
# Allow wildcard deletion of indices:
#
action.destructive_requires_name: false

xpack.security.enabled: false

第三步：启动ElasticSearch

node1、node2、node3 依次启动

#切换用户

su elsearch

#以后台常驻方式启动
#当前目录：/usr/local/elasticsearch-8.5.2
bin/elasticsearch -d

第四步：验证是否集群部署成功

一、先看单节点是否安装成功

1、访问node1地址 http://192.168.3.51:9200/_cat/health

1671329645 02:14:05 es8.5 green 3 3 19 9 0 0 0 0 - 100.0%

2、访问node2地址http://192.168.3.61:9200/_cat/health

1671329720 02:15:20 es8.5 green 3 3 19 9 0 0 0 0 - 100.0%

3、访问node2地址http://192.168.3.62:9200/_cat/health

1671329773 02:16:13 es8.5 green 3 3 19 9 0 0 0 0 - 100.0%

二、再看集群是否安装成功

http://192.168.3.51:9200/_cat/nodes?pretty

http://192.168.3.61:9200/_cat/nodes?pretty

http://192.168.3.62:9200/_cat/nodes?pretty

访问上面三个地址都会出现下面的内容

192.168.3.62 38 96 0 0.00 0.01 0.05 cdfhilmrstw - node-3
192.168.3.51 50 96 0 0.04 0.05 0.05 cdfhilmrstw - node-1
192.168.3.61 19 96 0 0.05 0.06 0.05 cdfhilmrstw * node-2

至此集群安装成功了

第五步：通过kibana使用集群 只在node1上安装

一、安装

#下载
wget https://artifacts.elastic.co/downloads/kibana/kibana-8.5.3-linux-x86_64.tar.gz
#解压 我的解压到/usr/local/
tar -xzf kibana-8.5.3-linux-x86_64.tar.gz

二、配置，修改配置文件

[root@master config]# pwd 
/usr/local/kibana-8.5.2/config
[root@master config]# vim kibana.yml

主要配置两项，其它默认，注意没有用https

elasticsearch.hosts: ['http://192.168.3.51:9200','http://192.168.3.61:9200','http://192.168.3.62:9200']

xpack.fleet.outputs: [{id: fleet-default-output, name: default, is_default: true, is_default_monitoring: true, type: elasticsearch, hosts: ['http://192.168.3.51:9200','http://192.168.3.61:9200','http://192.168.3.62:9200'], ca_trusted_fingerprint: d1894733c1444554b6a412b9bf27707bbdeeb661aa1d458a507dc7522abed0e2}]
 

三、启动

一、Kibana启动不能使用root用户， 使用上面创建的elsearch用户， 进行赋权：

chown -R elsearch:elsearch kibana-8.5.2
#切换用户

su elsearch


[elsearch@master kibana-8.5.2]$ pwd 
/usr/local/kibana-8.5.2
[elsearch@master kibana-8.5.2]$ bin/kibana &

四、登陆

http://192.168.3.51:5601/

用户名：elastic

密码说明：这种方式启动的elasticsearch（yum 安装的能看到初始秘密），启动日志好像没有看到初始秘密，可以通过修改密码

[elsearch@master bin]$ pwd 
/usr/local/elasticsearch-8.5.2/bin
[elsearch@master bin]$ ./elasticsearch-reset-password -u elastic 
warning: ignoring JAVA_HOME=/usr/app/jdk1.8.0_341; using bundled JDK
This tool will reset the password of the [elastic] user to an autogenerated value.
The password will be printed in the console.
Please confirm that you would like to continue [y/N]

五、使用kibana 搜索框输入Dev Tools

 PUT orders
{
    "settings": {
        "index": {
            "number_of_shards": 2, #分片数
            "number_of_replicas": 2  #副本数 当前三个节点（node1、node2、node3）有两个副本数
        }
    }
}

 可以看到health 是green 表示集群建立成功，如果elasticsearch是单节点，副本数为2health 是yellow

 如果修改副本数超过2 ，就会是yellon ,我这里设置了6，因为只有两个节点当副本

PUT orders03
{
    "settings": {
        "index": {
            "number_of_shards": 2,
            "number_of_replicas": 6
        }
    }
}

以上内容属于入门级，还有很多不懂的地方，努力学习实践

鳝鱼lebron
关注
  • 0
    点赞
  • 踩
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
elasticsearch-7.9.2 集群安装
删繁就简三秋树
12-04 260
1. 单机node1安装测试通过后，可以拷贝安装好的文件到node2、node3机器上https://blog.csdn.net/Aoico/article/details/108908713 （单机安装步骤） [root@node1 data]# scp -r elasticsearch-7.9.2/ node2:/data/ 2.修改配置 cluster.name: my-es #节点集群名字要一致 node.name: node1 #node2 此处改为 node2,...
elasticsearch6.6.1集群安装
genus_yang的博客
03-01 1155
haodoop集群elasticsearch6.6.1安装安装步骤安装依赖解压es压缩包修改配置文件elasticsearch.yml复制es安装包到其他节点elasticsearch.yml配置limits.conf配置sysctl.conf配置配置环境变量启动elasticsearches启动验证相关问题及解决 安装步骤 ElasticSearch是一个基于Lucene的搜索服务器。它提供了一...
Elasticsearch集群搭建手册及配置详情(基于elasticsearch-8.5.2版本)
一只小白
12-01 4522
Elasticsearch集群搭建手册及配置详情(基于elasticsearch-8.5.2版本)
一文看懂ELK日志查看安装配置（超详细）
小海鲜的博客
09-13 4267
1、安装包导入到文件夹下2、依次解压到各自文件夹下。
elasticsearch-8.5.3&kibana-8.5.3安装部署操作文档
最新发布
2301_77356579的博客
05-22 665
elsticsearch-8.5.3&kibana-8.5.3安装部署操作文档
Lucene全文检索引擎
fxyyshi的博客
08-04 243
    Lucene是apache软件基金会4 jakarta项目组的一个子项目，是一个开放源代码的全文检索引擎工具包，但它不是一个完整的全文检索引擎，而是一个全文检索引擎的架构，提供了完整的查询引擎和索引引擎，部分文本分析引擎（英文与德文两种西方语言）。Lucene的目的是为软件开发人员提供一个简单易用的工具包，以方便的在目标系统中实现全文检索的功能，或者是以此为基础建立起完整的全文检索引擎...
elasticsearch报错java.lang.IllegalStateException: failed to obtain node locks, tried [[/usr/local/elas
dsqcsdn的博客
09-09 9513
报错原因：没有正常停止elasticsearch 解决 #查看elastic的进程号 并杀死 ps aux | grep elasticsearch kill -9 进程号 #重启 -d 后台运行 ./bin/elasticsearch -d
Elasticsearch启动报错：fatal exception while booting Elasticsearchjava.lang.RuntimeException: can not run
不二青春
05-09 3704
Linux环境下Elasticsearch启动报错
java.lang.IllegalArgumentExceptio:ik的报错
qq_34281601的博客
08-22 3596
java.lang.IllegalArgumentExceptio:Unknown Analyzer type [org.elasticsearch.index.analysis.IkAnalyzerProvider] for[ik] 错误提示的很明显   未知的分词器for ik 分析认为可能是 elasticsearch-2.4.0\config\elasticsearch.yml 配置错
Elasticsearch集群安装配置.docx
02-05
Elasticsearch集群安装配置 Elasticsearch 是一个基于 Apache Lucene 的搜索和数据分析引擎，支持实时搜索、数据分析和报表生成等功能。为了实现高可用性和高性能，Elasticsearch 集群安装配置是非常重要的。本文将...
最新版windows elasticsearch-8.5.2-windows-x86-64.zip
11-25
该压缩包"elasticsearch-8.5.2-windows-x86_64.zip"包含了所有必要的组件，使用户能够在Windows环境下运行和管理Elasticsearch集群。 首先，让我们深入了解一下Elasticsearch的核心特性： 1. **分布式搜索与存储**...
docker安装Elasticsearch7.6集群并设置密码
09-29
主要介绍了docker安装Elasticsearch7.6集群并设置密码，文中通过示例代码介绍的非常详细，对大家的学习或者工作具有一定的参考学习价值，需要的朋友们下面随着小编来一起学习学习吧
es(elasticsearch)集群安装优化
06-11
对于集群的监控和优化是很重要的一部分，如果想持久维护集群，单单靠增加物理内存，cpu，硬盘是不够的，必须通过一些方法来进行优化。本文档包含： ...3、ES集群的heap参数优化； 4、集群的硬盘和CPU设置
elasticsearch启动异常InvalidPathException
qq_46129756的博客
04-08 2085
非法路径错误，估计是系统用户路径中带有非法字符或是中文字符，导致无法识别的问题 c:\Users\????\AppData\Local\Temp\elasticsearch，我原来的系统用户文件夹名称是中文名称，后来改成英文名称后就可以正常运行了。 建议系统用户名不要取中文 我是按照简书上这位大佬更改系统用户文件名称的步骤来的。 https://www.jianshu.com/p/a7812f10a055 ...
ore.MemorySegmentIndexInputProvider ＜init＞[2023-05-27T05:40:45,356][ERROR][o.e.b.Elasticsearch
记录下日常遇到的问题或者一些思考，不喜勿喷
05-27 700
出现这个问题是因为，我之前安装的是8.7的版本，安装了新版本的kibana 配置的时候不兼容。所以我怀疑有些进程没被干掉导致启动es报错，直接重启服务器，重启之后 再次启动正常。
Elasticsearch8.6启动异常：fatal exception while booting Elasticsearch
yang516521的博客
04-11 2584
elasticsearch8.6/8.7启动异常
启动 elasticsearch时报错 java.lang.IllegalStateException: Could not load plugin descriptor for plugin xxx
热门推荐
tmax52HZ的博客
06-05 1万+
java.lang.IllegalStateException: Could not load plugin descriptor for plugin directory [ik-analyzer] 一.出错场景 1.在安装了elasticsearch后 2.将elasticsearch-analysis-ik-6.2.4.zip放入plugins目录下后 3../elasticsearch启动 elasticsearch时报错 二.分析原因 1.首先，我没有使用root用户进行操作，已经创建了用户。而
Elasticsearch——》解决启动报错fatal exception while booting Elasticsearchjava.nio.file.InvalidPathException
小仙~
04-28 5829
2、现象 3、原因 环境变量classpath最后面空格！！！ 删除环境变量classpath最后面空格！！！再次重新启动！
升级Elasticsearch到8.7.1版本，我给自己挖了很多坑......
SRE成长记
11-15 1107
Elasticsearch集群到8.7.1版本踩坑记

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值