BS问题 elasticsearch8.5.2 集群安装

已于 2022-12-18 11:36:54 修改
阅读量1.7k 收藏 1
点赞数
分类专栏： elasticsearch摸索 文章标签： elasticsearch java 大数据
于 2022-12-18 11:22:15 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/qq_30337573/article/details/128359877
版权

环境 centos7

3台虚拟机(vagrant创建的)

node1=192.168.3.51,node2=192.168.3.61,node3=192.168.3.62

第一步：下载tar.gz文件，并且解压，我的是解压到/usr/local/

#node1、node2、node3 采用安装包安装

wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-8.5.2-linux-x86_64.tar.gz
wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-8.5.2-linux-x86_64.tar.gz.sha512
shasum -a 512 -c elasticsearch-8.5.2-linux-x86_64.tar.gz.sha512   
#如果没有命令：yum install perl-Digest-SHA
tar -xzf elasticsearch-8.5.2-linux-x86_64.tar.gz
cd elasticsearch-8.5.2/

第二步：系统配置

#ElasticSearch不能以Root身份运行， node1、node2、node3需要单独创建一个用户

groupadd elsearch
useradd elsearch -g elsearch -p elasticsearch
chown -R elsearch:elsearch  /usr/local/elasticsearch-8.5.2

问题描述：后面启动的时候可能出现问题，我的出现了

max virtual memory areas vm.max_map_count [65530] is too low, increase to at least 错误信息

#修改系统配置
vi /etc/sysctl.conf

#添加
vm.max_map_count=655360

#执行生效
sysctl -p

#继续修改
vi /etc/security/limits.conf

#在文件末尾添加（注意这些带*的也要添加，我开始以为是注销的就没有添加，然后就一堆错误）
* soft nofile 65536

* hard nofile 131072

* soft nproc 2048

* hard nproc 4096

elsearch soft nproc 125535

elsearch hard nproc 125535

第二步：修改配置文件

[elsearch@worker02 config]$ pwd
/usr/local/elasticsearch-8.5.2/config
[elsearch@worker02 config]$ vim elasticsearch.yml

需要注意一点：path.data参数三个节点的目录地址设置成不一样的路径，不然启动第二个节点的时候，有错误提示，大概意思是有节点以及获取了相同路径的锁，再次获取失败

[2022-12-18T01:00:30,311][ERROR][o.e.b.Elasticsearch      ] [node-2] fatal exception while booting Elasticsearchjava.lang.IllegalStateException: failed to obtain node locks, tried [/usr/local/elasticsearch-8.5.2/data]; maybe these locations are not writable or multiple nodes were started on the same data path?
	at org.elasticsearch.server@8.5.2/org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:285)
	at org.elasticsearch.server@8.5.2/org.elasticsearch.node.Node.<init>(Node.java:474)
	at org.elasticsearch.server@8.5.2/org.elasticsearch.node.Node.<init>(Node.java:318)
	at org.elasticsearch.server@8.5.2/org.elasticsearch.bootstrap.Elasticsearch$2.<init>(Elasticsearch.java:214)
	at org.elasticsearch.server@8.5.2/org.elasticsearch.bootstrap.Elasticsearch.initPhase3(Elasticsearch.java:214)

1、node1节点

在路径：/usr/local/elasticsearch-8.5.2/需要创建data目录（名字任取，只是要和配置文件一致 path.data: /usr/local/elasticsearch-8.5.2/data）


# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#       Before you set out to tweak and tune the configuration, make sure you
#       understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: es8.5
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: node-1
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /usr/local/elasticsearch-8.5.2/data
#
# Path to log files:
#
path.logs: /usr/local/elasticsearch-8.5.2/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# By default Elasticsearch is only accessible on localhost. Set a different
# address here to expose this node on the network:
#
network.host: 192.168.3.51
#
# By default Elasticsearch listens for HTTP traffic on the first free port it
# finds starting at 9200. Set a specific HTTP port here:
#
http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
discovery.seed_hosts: ["192.168.3.51", "192.168.3.61","192.168.62"]
#
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
#
#
cluster.initial_master_nodes: ["node-1", "node-2","node-3"]
#
# For more information, consult the discovery and cluster formation module documentation.
#
# --------------------------------- Readiness ----------------------------------
#
# Enable an unauthenticated TCP readiness endpoint on localhost
#
#readiness.port: 9399
#
# ---------------------------------- Various -----------------------------------
#
# Allow wildcard deletion of indices:
#
action.destructive_requires_name: false

xpack.security.enabled: false

2、node2节点

在路径：/usr/local/elasticsearch-8.5.2/需要创建data02目录（名字任取，只是要和配置文件一致 path.data: /usr/local/elasticsearch-8.5.2/data02）

# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#       Before you set out to tweak and tune the configuration, make sure you
#       understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: es8.5
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: node-2
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /usr/local/elasticsearch-8.5.2/data02
#
# Path to log files:
#
path.logs: /usr/local/elasticsearch-8.5.2/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# By default Elasticsearch is only accessible on localhost. Set a different
# address here to expose this node on the network:
#
network.host: 192.168.3.61
#
# By default Elasticsearch listens for HTTP traffic on the first free port it
# finds starting at 9200. Set a specific HTTP port here:
#
http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
discovery.seed_hosts: ["192.168.3.51", "192.168.3.61","192.168.62"]
#
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
cluster.initial_master_nodes: ["node-1", "node-2","node-3"]
#
#
# For more information, consult the discovery and cluster formation module documentation.
#
# --------------------------------- Readiness ----------------------------------
#
# Enable an unauthenticated TCP readiness endpoint on localhost
#
#readiness.port: 9399
#
# ---------------------------------- Various -----------------------------------
#
# Allow wildcard deletion of indices:
#
action.destructive_requires_name: false


xpack.security.enabled: false

3、node3

在路径：/usr/local/elasticsearch-8.5.2/需要创建data03目录（名字任取，只是要和配置文件一致 path.data: /usr/local/elasticsearch-8.5.2/data03）

# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#       Before you set out to tweak and tune the configuration, make sure you
#       understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: es8.5
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: node-3
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /usr/local/elasticsearch-8.5.2/data03
#
# Path to log files:
#
path.logs: /usr/local/elasticsearch-8.5.2/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# By default Elasticsearch is only accessible on localhost. Set a different
# address here to expose this node on the network:
#
network.host: 192.168.3.62
#
# By default Elasticsearch listens for HTTP traffic on the first free port it
# finds starting at 9200. Set a specific HTTP port here:
#
http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
discovery.seed_hosts: ["192.168.3.51", "192.168.3.61","192.168.62"]
#
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
cluster.initial_master_nodes: ["node-1", "node-2","node-3"]
#
#
# For more information, consult the discovery and cluster formation module documentation.
#
# --------------------------------- Readiness ----------------------------------
#
# Enable an unauthenticated TCP readiness endpoint on localhost
#
#readiness.port: 9399
#
# ---------------------------------- Various -----------------------------------
#
# Allow wildcard deletion of indices:
#
action.destructive_requires_name: false

xpack.security.enabled: false

第三步：启动ElasticSearch

node1、node2、node3 依次启动

#切换用户

su elsearch

#以后台常驻方式启动
#当前目录：/usr/local/elasticsearch-8.5.2
bin/elasticsearch -d

第四步：验证是否集群部署成功

一、先看单节点是否安装成功

1、访问node1地址 http://192.168.3.51:9200/_cat/health

1671329645 02:14:05 es8.5 green 3 3 19 9 0 0 0 0 - 100.0%

2、访问node2地址http://192.168.3.61:9200/_cat/health

1671329720 02:15:20 es8.5 green 3 3 19 9 0 0 0 0 - 100.0%

3、访问node2地址http://192.168.3.62:9200/_cat/health

1671329773 02:16:13 es8.5 green 3 3 19 9 0 0 0 0 - 100.0%

二、再看集群是否安装成功

http://192.168.3.51:9200/_cat/nodes?pretty

http://192.168.3.61:9200/_cat/nodes?pretty

http://192.168.3.62:9200/_cat/nodes?pretty

访问上面三个地址都会出现下面的内容

192.168.3.62 38 96 0 0.00 0.01 0.05 cdfhilmrstw - node-3
192.168.3.51 50 96 0 0.04 0.05 0.05 cdfhilmrstw - node-1
192.168.3.61 19 96 0 0.05 0.06 0.05 cdfhilmrstw * node-2

至此集群安装成功了

第五步：通过kibana使用集群 只在node1上安装

一、安装

#下载
wget https://artifacts.elastic.co/downloads/kibana/kibana-8.5.3-linux-x86_64.tar.gz
#解压 我的解压到/usr/local/
tar -xzf kibana-8.5.3-linux-x86_64.tar.gz

二、配置，修改配置文件

[root@master config]# pwd 
/usr/local/kibana-8.5.2/config
[root@master config]# vim kibana.yml

主要配置两项，其它默认，注意没有用https

elasticsearch.hosts: ['http://192.168.3.51:9200','http://192.168.3.61:9200','http://192.168.3.62:9200']

xpack.fleet.outputs: [{id: fleet-default-output, name: default, is_default: true, is_default_monitoring: true, type: elasticsearch, hosts: ['http://192.168.3.51:9200','http://192.168.3.61:9200','http://192.168.3.62:9200'], ca_trusted_fingerprint: d1894733c1444554b6a412b9bf27707bbdeeb661aa1d458a507dc7522abed0e2}]
 

三、启动

一、Kibana启动不能使用root用户， 使用上面创建的elsearch用户， 进行赋权：

chown -R elsearch:elsearch kibana-8.5.2
#切换用户

su elsearch


[elsearch@master kibana-8.5.2]$ pwd 
/usr/local/kibana-8.5.2
[elsearch@master kibana-8.5.2]$ bin/kibana &

四、登陆

http://192.168.3.51:5601/

用户名：elastic

密码说明：这种方式启动的elasticsearch（yum 安装的能看到初始秘密），启动日志好像没有看到初始秘密，可以通过修改密码

[elsearch@master bin]$ pwd 
/usr/local/elasticsearch-8.5.2/bin
[elsearch@master bin]$ ./elasticsearch-reset-password -u elastic 
warning: ignoring JAVA_HOME=/usr/app/jdk1.8.0_341; using bundled JDK
This tool will reset the password of the [elastic] user to an autogenerated value.
The password will be printed in the console.
Please confirm that you would like to continue [y/N]

五、使用kibana 搜索框输入Dev Tools

 PUT orders
{
    "settings": {
        "index": {
            "number_of_shards": 2, #分片数
            "number_of_replicas": 2  #副本数 当前三个节点（node1、node2、node3）有两个副本数
        }
    }
}

 可以看到health 是green 表示集群建立成功，如果elasticsearch是单节点，副本数为2health 是yellow

 如果修改副本数超过2 ，就会是yellon ,我这里设置了6，因为只有两个节点当副本

PUT orders03
{
    "settings": {
        "index": {
            "number_of_shards": 2,
            "number_of_replicas": 6
        }
    }
}

以上内容属于入门级，还有很多不懂的地方，努力学习实践

鳝鱼lebron
关注
  • 0
    点赞
  • 踩
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
ES集群安装错误记录
yangkei
09-05 5753
elasticsearch安装报错记录
Elasticsearch集群搭建手册及配置详情(基于elasticsearch-8.5.2版本)
一只小白
12-01 4526
Elasticsearch集群搭建手册及配置详情(基于elasticsearch-8.5.2版本)
ElasticSearch 8.x 安装及集群搭建
zzhongcy的专栏
10-17 5429
Elasticsearch，简称为ES。ES是一个开源的高扩展的分布式全文检索引擎，它可以近乎实时的存储、检索数据。Elasticsearch是面向文档的一种数据库，这意味着其不再需要行列式的表格字段约束。ES会存储整个构造好的数据或文档，然而不仅仅是储存数据，这使得文档中每个数据可以被标识，进而可以被检索。在ES中，执行index，search，sort或过滤文档等操作都不是传统意义上的行列式的数据。ES从根本上对数据的不同思考方式也正是他能应对复杂数据结构的全文检索的原因之一。
java.lang.IllegalArgumentException异常的正确解决方法
最新发布
爱生活爱学习。
04-30 4027
如果是自己编写的方法，要确保文档清晰地说明了方法的预期参数，以及可能抛出的异常类型和原因。异常，需要仔细检查代码逻辑，确认参数的合法性，优化异常处理，并确保代码质量和可靠性。：编写单元测试用例，覆盖各种可能的参数情况，以确保方法在各种条件下都能正确处理。：首先要查看异常的详细信息，包括异常堆栈跟踪，以确定出现异常的具体位置和原因。：对于从外部获取的输入数据，要进行有效性验证，确保其符合预期的格式和约束。：根据异常信息和检查结果，修改代码逻辑，确保不会再出现非法参数导致的异常。综上所述，要正确解决。
Rancher 部署 Elasticsearch 8.5.1 版本服务
小康子的博客
04-25 1251
从 es7 升级到 es8 之后，启动容器默认启用了 ssl 安全传输配置，但是在 Rancher 中部署的话，需要挂载 pvc 实现 data、logs 等目录持久化，启用 ssl 需要对证书等进行操作，非常麻烦，非常坑。本文以启用安全配置（即需要用户名密码接入服务）但不启用 ssl 为例，在 Rancher 中部署 es 8.5.1 版本服务。
java.lang.IllegalArgumentExceptio:ik的报错
qq_34281601的博客
08-22 3600
java.lang.IllegalArgumentExceptio:Unknown Analyzer type [org.elasticsearch.index.analysis.IkAnalyzerProvider] for[ik] 错误提示的很明显   未知的分词器for ik 分析认为可能是 elasticsearch-2.4.0\config\elasticsearch.yml 配置错
运行elasticsearch报错：fatal exception while booting Elasticsearchjava.nio
huiyi_T的博客
12-31 1611
里面显示报错信息：java.nio.file.NoSuchFileException: D:XXXX\Java\jdk-17\lib\tools.jar。我安装的elasticsearch8.11，执行elasticsearch时报错。去看了下logs文件夹里的elasticsearch.log文件。直接删除系统环境变量中的CLASSPATH。jdk17不需要配置环境变量。
Elasticsearch集群安装配置.docx
02-05
Elasticsearch集群安装配置 Elasticsearch 是一个基于 Apache Lucene 的搜索和数据分析引擎，支持实时搜索、数据分析和报表生成等功能。为了实现高可用性和高性能，Elasticsearch 集群安装配置是非常重要的。本文将...
最新版windows elasticsearch-8.5.2-windows-x86-64.zip
11-25
该压缩包"elasticsearch-8.5.2-windows-x86_64.zip"包含了所有必要的组件，使用户能够在Windows环境下运行和管理Elasticsearch集群。 首先，让我们深入了解一下Elasticsearch的核心特性： 1. **分布式搜索与存储**...
docker安装Elasticsearch7.6集群并设置密码
09-29
主要介绍了docker安装Elasticsearch7.6集群并设置密码，文中通过示例代码介绍的非常详细，对大家的学习或者工作具有一定的参考学习价值，需要的朋友们下面随着小编来一起学习学习吧
es(elasticsearch)集群安装优化
06-11
对于集群的监控和优化是很重要的一部分，如果想持久维护集群，单单靠增加物理内存，cpu，硬盘是不够的，必须通过一些方法来进行优化。本文档包含： ...3、ES集群的heap参数优化； 4、集群的硬盘和CPU设置
elasticsearch-2.2.1.zip
08-08
elasticsearch-2.2.1 elasticsearch-2.2.1 elasticsearch-2.2.1
闪退报错--＞Elasticsearchjava.nio.file.NoSuchFileException: elasticsearch-8.8.2\%JAVA_HOME%\lib\dt.jar
个人笔记总结
07-12 2439
ElasticSearch8 闪退和启动报错-->fatal exception while booting Elasticsearch java.nio.file.NoSuchFileException-->Elasticsearchjava.nio.file.NoSuchFileException: dt.jar
elasticsearch报错java.lang.IllegalStateException: failed to obtain node locks, tried [[/usr/local/elas
qq_44918089的博客
07-25 270
到镜像下载文件夹里把es-data和es-plugins的_data文件里的东西全部删除，然后重新运行就可以了。运行之后访问9200后直接挂掉。
搜索引擎ElastaticSearch使用
qq_21703795的博客
07-15 632
elastaticsearch使用教程
java.lang.IllegalArgumentException异常解决
热门推荐
静待花开
07-03 17万+
在maven项目中测试代码的时候，碰到java.lang.IllegalArgumentException异常：严重: Servlet.service() for servlet [e3-manager] in context with path [] threw exception [Request processing failed; nested exception is java.lang...
Elasticsearch集群搭建
weixin_41487487的博客
03-10 2851
目录 WIndow集群 Linux集群 单点部署 集群部署 ES优化 硬件选择 分片策略 推迟分片分配 路由选择 写入速度优化 批量数据提交 优化存储设备 合理使用合并 减少Refresh的次数 加大Flush设置 减少副本的数量 内存设置 重要配置 WIndow集群 创建elasticsearch-cluster文件夹，在内部复制三个elasticsearch服务 修改集群文件目录下每个节点的config/elasticsearch.yml配置文件
Elasticsearch 6.4.2 集群配置全攻略
"这篇文档是关于Elasticsearch 6.4.2集群的安装配置教程，涵盖了相关插件的安装和服务的启停与测试。Elasticsearch是一个基于Apache Lucene的分布式、实时搜索引擎，用于存储和检索结构化或非结构化数据。文中详细...

“相关推荐”对你有帮助么？

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值