快速搭建开发环境 - Elasticsearch

最新推荐文章于 2023-06-29 12:12:42 发布
最新推荐文章于 2023-06-29 12:12:42 发布
阅读量1.3k 收藏
点赞数
分类专栏： 开发环境专题 文章标签： elasticsearch linux java docker centos
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/qq_34051004/article/details/105787062
版权

快速搭建开发环境 - Elasticsearch

一、官网

官网 https://www.elastic.co/cn/

下载 https://www.elastic.co/cn/downloads/elasticsearch

二、简介

​ Elasticsearch 是一个分布式、RESTful 风格的搜索和数据分析引擎，能够解决不断涌现出的各种用例。 作为 Elastic Stack 的核心，它集中存储您的数据，帮助您发现意料之中以及意料之外的情况。

三、源码安装

系统版本

[root@localhost local]# cat /etc/redhat-release
CentOS Linux release 7.7.1908 (Core)

软件版本

elasticsearch-6.8.7

安装

参考博客 https://blog.csdn.net/ltgsoldier1/article/details/97393154

[root@localhost local]# tar -zxf elasticsearch-6.8.7.tar.gz
[root@localhost local]# cd elasticsearch-6.8.7/
[root@localhost elasticsearch-6.8.7]# ll
total 460
drwxr-xr-x  3 631 503   4096 Apr 27 00:48 bin
drwxr-xr-x  2 631 503    148 Apr 27 00:48 config
drwxr-xr-x  3 631 503   4096 Apr 27 00:48 lib
-rw-r--r--  1 631 503  13675 Feb 26 14:36 LICENSE.txt
drwxr-xr-x  2 631 503      6 Feb 26 14:41 logs
drwxr-xr-x 31 631 503   4096 Feb 26 14:41 modules
-rw-r--r--  1 631 503 427502 Feb 26 14:41 NOTICE.txt
drwxr-xr-x  2 631 503      6 Feb 26 14:41 plugins
-rw-r--r--  1 631 503   8534 Feb 26 14:36 README.textile
[root@localhost elasticsearch-6.8.7]#
[root@localhost elasticsearch-6.8.7]# ll config/
total 32
-rw-r----- 1 631 503  2853 Feb 26 14:36 elasticsearch.yml	#ES启动基础配置
-rw-r----- 1 631 503  3740 Feb 26 14:36 jvm.options			#ES启动时JVM配置
-rw-r----- 1 631 503 13085 Feb 26 14:41 log4j2.properties	#ES日志输出配置文件
-rw-r----- 1 631 503   473 Feb 26 14:41 role_mapping.yml
-rw-r----- 1 631 503   197 Feb 26 14:41 roles.yml
-rw-r----- 1 631 503     0 Feb 26 14:41 users
-rw-r----- 1 631 503     0 Feb 26 14:41 users_roles
[root@localhost elasticsearch-6.8.7]#
修改配置文件

  • 修改jvm配置信息： config/jvm.options

  • 修改elastic配置文件： config/kibana.yml

  • 修改数据和日志存放路径：(请根据实际情况进行设置)

    path.data: /usr/local/elasticsearch/data # 数据目录位置
path.logs: /usr/local/elasticsearch/logs # 日志目录位置
创建用户

elastic 不允许使用 root 用户启动

[root@localhost elasticsearch-6.8.7]# groupadd elastic
[root@localhost elasticsearch-6.8.7]# useradd es -p elastic
[root@localhost elasticsearch-6.8.7]# chown -R es:elastic /usr/local/elasticsearch-6.8.7
启动
[root@localhost elasticsearch-6.8.7]# su es
[es@localhost elasticsearch-6.8.7]$ ./bin/elasticsearch

注：这里不能使用 root 用户启动

停止
[root@localhost elasticsearch-6.8.7]# jps
4265 Elasticsearch
4764 Jps

四、docker安装

[root@localhost ~]# docker pull elasticsearch:6.8.7
[root@localhost ~]# docker images
REPOSITORY         TAG          IMAGE ID            CREATED             SIZE
elasticsearch      6.8.7        b1179d41a7b4        6 months ago        855MB
[root@localhost ~]# docker run -d --name elasticsearch -p 9200:9200 -p 9300:9300 --net es-net elasticsearch:6.8.7

五、x-pack配置

六、插件安装

1）查看已安装插件

[root@localhost elasticsearch-6.8.7]# ./bin/elasticsearch-plugin list
[root@localhost elasticsearch-6.8.7]#

2）在线安装

bin/elasticsearch-plugin install plugin

3）离线安装

官网 https://www.elastic.co/guide/en/elasticsearch/plugins/current/plugin-management-custom-url.html

bin/elasticsearch-plugin install file:///path/to/plugin.zip

4）删除插件

bin/elasticsearch-plugin remove plugin

ingest-attachment

官网 https://www.elastic.co/guide/en/elasticsearch/plugins/6.8/ingest-attachment.html

[root@localhost elasticsearch-6.8.7]# ./bin/elasticsearch-plugin install file:///usr/local/elasticsearch-6.8.7/ingest-attachment-6.8.7.zip
-> Downloading file:///usr/local/elasticsearch-6.8.7/ingest-attachment-6.8.7.zip
[=================================================] 100%  
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.lang.RuntimePermission accessClassInPackage.sun.java2d.cmm.kcms
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.security.SecurityPermission createAccessControlContext
* java.security.SecurityPermission insertProvider
* java.security.SecurityPermission putProviderProperty.BC
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

Continue with installation? [y/N]y
-> Installed ingest-attachment
[root@localhost elasticsearch-6.8.7]#
[root@localhost elasticsearch-6.8.7]# ./bin/elasticsearch-plugin list
ingest-attachment
[root@localhost elasticsearch-6.8.7]#

analysis-hanlp

https://github.com/KennFalcon/elasticsearch-analysis-hanlp

[root@localhost elasticsearch-6.8.7]# ./bin/elasticsearch-plugin install https://github.com/KennFalcon/elasticsearch-analysis-hanlp/releases/download/v6.7.1/elasticsearch-analysis-hanlp-6.7.1.zip

analysis-ik

https://github.com/medcl/elasticsearch-analysis-ik

[root@localhost elasticsearch-6.8.7]# ./bin/elasticsearch-plugin install https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v6.8.7/elasticsearch-analysis-ik-6.8.7.zip
[root@localhost elasticsearch-6.8.7]# ./bin/elasticsearch-plugin list
analysis-ik
ingest-attachment
[root@localhost elasticsearch-6.8.7]#

踩坑记录

参考博客 http://www.72xit.com/1877.jsp

1、can not run elasticsearch as root

[root@localhost elasticsearch-6.8.7]# ./bin/elasticsearch
[2020-04-27T01:09:59,005][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-1] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.RuntimeException: can not run elasticsearch as root
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-6.8.7.jar:6.8.7]
        at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:116) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:93) ~[elasticsearch-6.8.7.jar:6.8.7]
Caused by: java.lang.RuntimeException: can not run elasticsearch as root
        at org.elasticsearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:103) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:170) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:333) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-6.8.7.jar:6.8.7]
        ... 6 more
[root@localhost elasticsearch-6.8.7]#

2、unknown setting [cluster.initial_master_nodes]

[es@localhost elasticsearch-6.8.7]$ ./bin/elasticsearch
......
[2020-04-27T01:14:53,724][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-1] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.IllegalArgumentException: unknown setting [cluster.initial_master_nodes] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-6.8.7.jar:6.8.7]
        at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:116) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:93) ~[elasticsearch-6.8.7.jar:6.8.7]
Caused by: java.lang.IllegalArgumentException: unknown setting [cluster.initial_master_nodes] please check that any required plugins are installed, or check the breaking changes documentation for removed settings
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:530) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:475) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:446) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.common.settings.AbstractScopedSettings.validate(AbstractScopedSettings.java:417) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.common.settings.SettingsModule.<init>(SettingsModule.java:148) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.node.Node.<init>(Node.java:374) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.node.Node.<init>(Node.java:266) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:212) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:212) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:333) ~[elasticsearch-6.8.7.jar:6.8.7]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-6.8.7.jar:6.8.7]
        ... 6 more
[es@localhost elasticsearch-6.8.7]$

3、ERROR: [2] bootstrap checks failed

[es@localhost elasticsearch-6.8.7]$ ./bin/elasticsearch
......
[2020-04-27T01:18:56,151][INFO ][o.e.x.s.a.s.FileRolesStore] [node-1] parsed [0] roles from file [/usr/local/elasticsearch-6.8.7/config/roles.yml]
[2020-04-27T01:18:56,824][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [node-1] [controller/3399] [Main.cc@109] controller (64 bit): Version 6.8.7 (Build f3f0534e9623b3) Copyright (c) 2020 Elasticsearch BV
[2020-04-27T01:18:57,226][DEBUG][o.e.a.ActionModule       ] [node-1] Using REST wrapper from plugin org.elasticsearch.xpack.security.Security
[2020-04-27T01:18:57,412][INFO ][o.e.d.DiscoveryModule    ] [node-1] using discovery type [zen] and host providers [settings]
[2020-04-27T01:18:58,158][INFO ][o.e.n.Node               ] [node-1] initialized
[2020-04-27T01:18:58,159][INFO ][o.e.n.Node               ] [node-1] starting ...
[2020-04-27T01:18:58,296][INFO ][o.e.t.TransportService   ] [node-1] publish_address {10.0.2.15:9300}, bound_addresses {[::]:9300}
[2020-04-27T01:18:58,320][INFO ][o.e.b.BootstrapChecks    ] [node-1] bound or publishing to a non-loopback address, enforcing bootstrap checks
ERROR: [2] bootstrap checks failed
[1]: max file descriptors [4096] for elasticsearch process is too low, increase to at least [65535]
[2]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
[2020-04-27T01:18:58,339][INFO ][o.e.n.Node               ] [node-1] stopping ...
[2020-04-27T01:18:58,353][INFO ][o.e.n.Node               ] [node-1] stopped
[2020-04-27T01:18:58,353][INFO ][o.e.n.Node               ] [node-1] closing ...
[2020-04-27T01:18:58,366][INFO ][o.e.n.Node               ] [node-1] closed
[es@localhost elasticsearch-6.8.7]$

参考博客 https://blog.csdn.net/ltgsoldier1/article/details/97393154

错误原因： 启动检查未通过

  1. 用户的最大线程数太低

  2. 进程虚拟内存太低

    解决方案

    1. 修改vim /etc/security/limits.d/90-nproc.conf 将默认值改为4096或更大
    2. 修改vim /etc/sysctl.conf，追加以下内容：vm.max_map_count=655360保存后，执行：sysctl -p
[es@localhost elasticsearch-6.8.7]$ vi /etc/security/limits.d/20-nproc.conf
bin/            data/           LICENSE.txt     modules/        plugins/
config/         lib/            logs/           NOTICE.txt      README.textile

[es@localhost elasticsearch-6.8.7]$ vi /etc/sys
sysconfig/          sysctl.conf         sysctl.d/           systemd/            system-release      system-release-cpe
[es@localhost elasticsearch-6.8.7]$ vi /etc/sysctl.conf

[root@localhost elasticsearch-6.8.7]# ulimit -Hn
4096
[root@localhost elasticsearch-6.8.7]# ulimit -Sn
1024
[root@localhost elasticsearch-6.8.7]# vi /etc/security/limits.conf
es         hard    nofile   65536
es         soft    nofile   65536
es         soft    nproc    4096
es         hard    nproc    4096

重新登录后查看

[root@localhost vagrant]# su es
[es@localhost vagrant]$ ulimit -Hn
65535

插件安装错误

1、Plugin [ingest-attachment] was built for Elasticsearch version 6.8.8 but version 6.8.7 is running
[root@localhost elasticsearch-6.8.7]# ./bin/elasticsearch-plugin install file:///usr/local/elasticsearch-6.8.7/plugins/ingest-attachment-6.8.8.zip
-> Downloading file:///usr/local/elasticsearch-6.8.7/plugins/ingest-attachment-6.8.8.zip
[=================================================] 100%  
Exception in thread "main" java.lang.IllegalArgumentException: Plugin [ingest-attachment] was built for Elasticsearch version 6.8.8 but version 6.8.7 is running
        at org.elasticsearch.plugins.PluginsService.verifyCompatibility(PluginsService.java:346)
        at org.elasticsearch.plugins.InstallPluginCommand.loadPluginInfo(InstallPluginCommand.java:728)
        at org.elasticsearch.plugins.InstallPluginCommand.installPlugin(InstallPluginCommand.java:803)
        at org.elasticsearch.plugins.InstallPluginCommand.install(InstallPluginCommand.java:786)
        at org.elasticsearch.plugins.InstallPluginCommand.execute(InstallPluginCommand.java:232)
        at org.elasticsearch.plugins.InstallPluginCommand.execute(InstallPluginCommand.java:217)
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86)
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124)
        at org.elasticsearch.cli.MultiCommand.execute(MultiCommand.java:77)
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124)
        at org.elasticsearch.cli.Command.main(Command.java:90)
        at org.elasticsearch.plugins.PluginCli.main(PluginCli.java:47)
[root@localhost elasticsearch-6.8.7]#

附：配置文件

Elasticsearch Configuration

# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#       Before you set out to tweak and tune the configuration, make sure you
#       understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: my-application
cluster.initial_master_nodes: ["node-1"]
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: node-1
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /usr/local/elasticsearch-6.8.7/data
#
# Path to log files:
#
path.logs: /usr/local/elasticsearch-6.8.7/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
bootstrap.memory_lock: false
bootstrap.system_call_filter: false
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# Set the bind address to a specific IP (IPv4 or IPv6):
#
network.host: 0.0.0.0
#
# Set a custom port for HTTP:
#
http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when new node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
#discovery.zen.ping.unicast.hosts: ["host1", "host2"]
#
# Prevent the "split brain" by configuring the majority of nodes (total number of master-eligible nodes / 2 + 1):
#
#discovery.zen.minimum_master_nodes: 
#
# For more information, consult the zen discovery module documentation.
#
# ---------------------------------- Gateway -----------------------------------
#
# Block initial recovery after a full cluster restart until N nodes are started:
#
#gateway.recover_after_nodes: 3
#
# For more information, consult the gateway module documentation.
#
# ---------------------------------- Various -----------------------------------
#
# Require explicit names when deleting indices:
#
#action.destructive_requires_name: true

JVM configuration

## JVM configuration

################################################################
## IMPORTANT: JVM heap size
################################################################
##
## You should always set the min and max JVM heap
## size to the same value. For example, to set
## the heap to 4 GB, set:
##
## -Xms4g
## -Xmx4g
##
## See https://www.elastic.co/guide/en/elasticsearch/reference/current/heap-size.html
## for more information
##
################################################################

# Xms represents the initial size of total heap space
# Xmx represents the maximum size of total heap space

-Xms256m
-Xmx256m

################################################################
## Expert settings
################################################################
##
## All settings below this section are considered
## expert settings. Don't tamper with them unless
## you understand what you are doing
##
################################################################

## GC configuration
8-13:-XX:+UseConcMarkSweepGC
8-13:-XX:CMSInitiatingOccupancyFraction=75
8-13:-XX:+UseCMSInitiatingOccupancyOnly

## G1GC Configuration
# NOTE: G1 GC is only supported on JDK version 10 or later
# to use G1GC, uncomment the next two lines and update the version on the
# following three lines to your version of the JDK
# 10-13:-XX:-UseConcMarkSweepGC
# 10-13:-XX:-UseCMSInitiatingOccupancyOnly
14-:-XX:+UseG1GC
14-:-XX:G1ReservePercent=25
14-:-XX:InitiatingHeapOccupancyPercent=30

## DNS cache policy
# cache ttl in seconds for positive DNS lookups noting that this overrides the
# JDK security property networkaddress.cache.ttl; set to -1 to cache forever
-Des.networkaddress.cache.ttl=60
# cache ttl in seconds for negative DNS lookups noting that this overrides the
# JDK security property networkaddress.cache.negative ttl; set to -1 to cache
# forever
-Des.networkaddress.cache.negative.ttl=10

## optimizations

# pre-touch memory pages used by the JVM during initialization
-XX:+AlwaysPreTouch

## basic

# explicitly set the stack size
-Xss1m

# set to headless, just in case
-Djava.awt.headless=true

# ensure UTF-8 encoding by default (e.g. filenames)
-Dfile.encoding=UTF-8

# use our provided JNA always versus the system one
-Djna.nosys=true

# turn off a JDK optimization that throws away stack traces for common
# exceptions because stack traces are important for debugging
-XX:-OmitStackTraceInFastThrow

# flags to configure Netty
-Dio.netty.noUnsafe=true
-Dio.netty.noKeySetOptimization=true
-Dio.netty.recycler.maxCapacityPerThread=0

# log4j 2
-Dlog4j.shutdownHookEnabled=false
-Dlog4j2.disable.jmx=true

-Djava.io.tmpdir=${ES_TMPDIR}

## heap dumps

# generate a heap dump when an allocation from the Java heap fails
# heap dumps are created in the working directory of the JVM
-XX:+HeapDumpOnOutOfMemoryError

# specify an alternative path for heap dumps; ensure the directory exists and
# has sufficient space
-XX:HeapDumpPath=data

# specify an alternative path for JVM fatal error logs
-XX:ErrorFile=logs/hs_err_pid%p.log

## JDK 8 GC logging

8:-XX:+PrintGCDetails
8:-XX:+PrintGCDateStamps
8:-XX:+PrintTenuringDistribution
8:-XX:+PrintGCApplicationStoppedTime
8:-Xloggc:logs/gc.log
8:-XX:+UseGCLogFileRotation
8:-XX:NumberOfGCLogFiles=32
8:-XX:GCLogFileSize=64m

# JDK 9+ GC logging
9-:-Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m
# due to internationalization enhancements in JDK 9 Elasticsearch need to set the provider to COMPAT otherwise
# time/date parsing will break in an incompatible way for some date patterns and locals
9-:-Djava.locale.providers=COMPAT

# temporary workaround for C2 bug with JDK 10 on hardware with AVX-512
10-:-XX:UseAVX=2

log4j2.properties

status = error

# log action execution errors for easier debugging
logger.action.name = org.elasticsearch.action
logger.action.level = debug

appender.console.type = Console
appender.console.name = console
appender.console.layout.type = PatternLayout
appender.console.layout.pattern = [%d{ISO8601}][%-5p][%-25c{1.}] [%node_name]%marker %m%n

appender.rolling.type = RollingFile
appender.rolling.name = rolling
appender.rolling.fileName = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}.log
appender.rolling.layout.type = PatternLayout
appender.rolling.layout.pattern = [%d{ISO8601}][%-5p][%-25c{1.}] [%node_name]%marker %.-10000m%n
appender.rolling.filePattern = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}-%d{yyyy-MM-dd}-%i.log.gz
appender.rolling.policies.type = Policies
appender.rolling.policies.time.type = TimeBasedTriggeringPolicy
appender.rolling.policies.time.interval = 1
appender.rolling.policies.time.modulate = true
appender.rolling.policies.size.type = SizeBasedTriggeringPolicy
appender.rolling.policies.size.size = 128MB
appender.rolling.strategy.type = DefaultRolloverStrategy
appender.rolling.strategy.fileIndex = nomax
appender.rolling.strategy.action.type = Delete
appender.rolling.strategy.action.basepath = ${sys:es.logs.base_path}
appender.rolling.strategy.action.condition.type = IfFileName
appender.rolling.strategy.action.condition.glob = ${sys:es.logs.cluster_name}-*
appender.rolling.strategy.action.condition.nested_condition.type = IfAccumulatedFileSize
appender.rolling.strategy.action.condition.nested_condition.exceeds = 2GB

rootLogger.level = info
rootLogger.appenderRef.console.ref = console
rootLogger.appenderRef.rolling.ref = rolling

appender.deprecation_rolling.type = RollingFile
appender.deprecation_rolling.name = deprecation_rolling
appender.deprecation_rolling.fileName = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}_deprecation.log
appender.deprecation_rolling.layout.type = PatternLayout
appender.deprecation_rolling.layout.pattern = [%d{ISO8601}][%-5p][%-25c{1.}] [%node_name]%marker %.-10000m%n
appender.deprecation_rolling.filePattern = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}_deprecation-%i.log.gz
appender.deprecation_rolling.policies.type = Policies
appender.deprecation_rolling.policies.size.type = SizeBasedTriggeringPolicy
appender.deprecation_rolling.policies.size.size = 1GB
appender.deprecation_rolling.strategy.type = DefaultRolloverStrategy
appender.deprecation_rolling.strategy.max = 4

logger.deprecation.name = org.elasticsearch.deprecation
logger.deprecation.level = warn
logger.deprecation.appenderRef.deprecation_rolling.ref = deprecation_rolling
logger.deprecation.additivity = false

appender.index_search_slowlog_rolling.type = RollingFile
appender.index_search_slowlog_rolling.name = index_search_slowlog_rolling
appender.index_search_slowlog_rolling.fileName = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}_index_search_slowlog.log
appender.index_search_slowlog_rolling.layout.type = PatternLayout
appender.index_search_slowlog_rolling.layout.pattern = [%d{ISO8601}][%-5p][%-25c] [%node_name]%marker %.-10000m%n
appender.index_search_slowlog_rolling.filePattern = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}_index_search_slowlog-%d{yyyy-MM-dd}.log
appender.index_search_slowlog_rolling.policies.type = Policies
appender.index_search_slowlog_rolling.policies.time.type = TimeBasedTriggeringPolicy
appender.index_search_slowlog_rolling.policies.time.interval = 1
appender.index_search_slowlog_rolling.policies.time.modulate = true

logger.index_search_slowlog_rolling.name = index.search.slowlog
logger.index_search_slowlog_rolling.level = trace
logger.index_search_slowlog_rolling.appenderRef.index_search_slowlog_rolling.ref = index_search_slowlog_rolling
logger.index_search_slowlog_rolling.additivity = false

appender.index_indexing_slowlog_rolling.type = RollingFile
appender.index_indexing_slowlog_rolling.name = index_indexing_slowlog_rolling
appender.index_indexing_slowlog_rolling.fileName = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}_index_indexing_slowlog.log
appender.index_indexing_slowlog_rolling.layout.type = PatternLayout
appender.index_indexing_slowlog_rolling.layout.pattern = [%d{ISO8601}][%-5p][%-25c] [%node_name]%marker %.-10000m%n
appender.index_indexing_slowlog_rolling.filePattern = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}_index_indexing_slowlog-%d{yyyy-MM-dd}.log
appender.index_indexing_slowlog_rolling.policies.type = Policies
appender.index_indexing_slowlog_rolling.policies.time.type = TimeBasedTriggeringPolicy
appender.index_indexing_slowlog_rolling.policies.time.interval = 1
appender.index_indexing_slowlog_rolling.policies.time.modulate = true

logger.index_indexing_slowlog.name = index.indexing.slowlog.index
logger.index_indexing_slowlog.level = trace
logger.index_indexing_slowlog.appenderRef.index_indexing_slowlog_rolling.ref = index_indexing_slowlog_rolling
logger.index_indexing_slowlog.additivity = false


appender.audit_rolling.type = RollingFile
appender.audit_rolling.name = audit_rolling
appender.audit_rolling.fileName = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}_audit.log
appender.audit_rolling.layout.type = PatternLayout
appender.audit_rolling.layout.pattern = {\
                "@timestamp":"%d{ISO8601}"\
                %varsNotEmpty{, "node.name":"%enc{%map{node.name}}{JSON}"}\
                %varsNotEmpty{, "node.id":"%enc{%map{node.id}}{JSON}"}\
                %varsNotEmpty{, "host.name":"%enc{%map{host.name}}{JSON}"}\
                %varsNotEmpty{, "host.ip":"%enc{%map{host.ip}}{JSON}"}\
                %varsNotEmpty{, "event.type":"%enc{%map{event.type}}{JSON}"}\
                %varsNotEmpty{, "event.action":"%enc{%map{event.action}}{JSON}"}\
                %varsNotEmpty{, "user.name":"%enc{%map{user.name}}{JSON}"}\
                %varsNotEmpty{, "user.run_by.name":"%enc{%map{user.run_by.name}}{JSON}"}\
                %varsNotEmpty{, "user.run_as.name":"%enc{%map{user.run_as.name}}{JSON}"}\
                %varsNotEmpty{, "user.realm":"%enc{%map{user.realm}}{JSON}"}\
                %varsNotEmpty{, "user.run_by.realm":"%enc{%map{user.run_by.realm}}{JSON}"}\
                %varsNotEmpty{, "user.run_as.realm":"%enc{%map{user.run_as.realm}}{JSON}"}\
                %varsNotEmpty{, "user.roles":%map{user.roles}}\
                %varsNotEmpty{, "origin.type":"%enc{%map{origin.type}}{JSON}"}\
                %varsNotEmpty{, "origin.address":"%enc{%map{origin.address}}{JSON}"}\
                %varsNotEmpty{, "realm":"%enc{%map{realm}}{JSON}"}\
                %varsNotEmpty{, "url.path":"%enc{%map{url.path}}{JSON}"}\
                %varsNotEmpty{, "url.query":"%enc{%map{url.query}}{JSON}"}\
                %varsNotEmpty{, "request.method":"%enc{%map{request.method}}{JSON}"}\
                %varsNotEmpty{, "request.body":"%enc{%map{request.body}}{JSON}"}\
                %varsNotEmpty{, "request.id":"%enc{%map{request.id}}{JSON}"}\
                %varsNotEmpty{, "action":"%enc{%map{action}}{JSON}"}\
                %varsNotEmpty{, "request.name":"%enc{%map{request.name}}{JSON}"}\
                %varsNotEmpty{, "indices":%map{indices}}\
                %varsNotEmpty{, "opaque_id":"%enc{%map{opaque_id}}{JSON}"}\
                %varsNotEmpty{, "x_forwarded_for":"%enc{%map{x_forwarded_for}}{JSON}"}\
                %varsNotEmpty{, "transport.profile":"%enc{%map{transport.profile}}{JSON}"}\
                %varsNotEmpty{, "rule":"%enc{%map{rule}}{JSON}"}\
                %varsNotEmpty{, "event.category":"%enc{%map{event.category}}{JSON}"}\
                }%n
# "node.name" node name from the `elasticsearch.yml` settings
# "node.id" node id which should not change between cluster restarts
# "host.name" unresolved hostname of the local node
# "host.ip" the local bound ip (i.e. the ip listening for connections)
# "event.type" a received REST request is translated into one or more transport requests. This indicates which processing layer generated the event "rest" or "transport" (internal)
# "event.action" the name of the audited event, eg. "authentication_failed", "access_granted", "run_as_granted", etc.
# "user.name" the subject name as authenticated by a realm
# "user.run_by.name" the original authenticated subject name that is impersonating another one.
# "user.run_as.name" if this "event.action" is of a run_as type, this is the subject name to be impersonated as.
# "user.realm" the name of the realm that authenticated "user.name"
# "user.run_by.realm" the realm name of the impersonating subject ("user.run_by.name")
# "user.run_as.realm" if this "event.action" is of a run_as type, this is the realm name the impersonated user is looked up from
# "user.roles" the roles array of the user; these are the roles that are granting privileges
# "origin.type" it is "rest" if the event is originating (is in relation to) a REST request; possible other values are "transport" and "ip_filter"
# "origin.address" the remote address and port of the first network hop, i.e. a REST proxy or another cluster node
# "realm" name of a realm that has generated an "authentication_failed" or an "authentication_successful"; the subject is not yet authenticated
# "url.path" the URI component between the port and the query string; it is percent (URL) encoded
# "url.query" the URI component after the path and before the fragment; it is percent (URL) encoded
# "request.method" the method of the HTTP request, i.e. one of GET, POST, PUT, DELETE, OPTIONS, HEAD, PATCH, TRACE, CONNECT
# "request.body" the content of the request body entity, JSON escaped
# "request.id" a synthentic identifier for the incoming request, this is unique per incoming request, and consistent across all audit events generated by that request
# "action" an action is the most granular operation that is authorized and this identifies it in a namespaced way (internal)
# "request.name" if the event is in connection to a transport message this is the name of the request class, similar to how rest requests are identified by the url path (internal)
# "indices" the array of indices that the "action" is acting upon
# "opaque_id" opaque value conveyed by the "X-Opaque-Id" request header
# "x_forwarded_for" the addresses from the "X-Forwarded-For" request header, as a verbatim string value (not an array)
# "transport.profile" name of the transport profile in case this is a "connection_granted" or "connection_denied" event
# "rule" name of the applied rulee if the "origin.type" is "ip_filter"
# "event.category" fixed value "elasticsearch-audit"

appender.audit_rolling.filePattern = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}_audit-%d{yyyy-MM-dd}.log
appender.audit_rolling.policies.type = Policies
appender.audit_rolling.policies.time.type = TimeBasedTriggeringPolicy
appender.audit_rolling.policies.time.interval = 1
appender.audit_rolling.policies.time.modulate = true

appender.deprecated_audit_rolling.type = RollingFile
appender.deprecated_audit_rolling.name = deprecated_audit_rolling
appender.deprecated_audit_rolling.fileName = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}_access.log
appender.deprecated_audit_rolling.layout.type = PatternLayout
appender.deprecated_audit_rolling.layout.pattern = [%d{ISO8601}] %m%n
appender.deprecated_audit_rolling.filePattern = ${sys:es.logs.base_path}${sys:file.separator}${sys:es.logs.cluster_name}_access-%d{yyyy-MM-dd}.log
appender.deprecated_audit_rolling.policies.type = Policies
appender.deprecated_audit_rolling.policies.time.type = TimeBasedTriggeringPolicy
appender.deprecated_audit_rolling.policies.time.interval = 1
appender.deprecated_audit_rolling.policies.time.modulate = true

logger.xpack_security_audit_logfile.name = org.elasticsearch.xpack.security.audit.logfile.LoggingAuditTrail
logger.xpack_security_audit_logfile.level = info
logger.xpack_security_audit_logfile.appenderRef.audit_rolling.ref = audit_rolling
logger.xpack_security_audit_logfile.additivity = false

logger.xpack_security_audit_deprecated_logfile.name = org.elasticsearch.xpack.security.audit.logfile.DeprecatedLoggingAuditTrail
# set this to "off" instead of "info" to disable the deprecated appender
# in the 6.x releases both the new and the previous appenders are enabled
# for the logfile auditing
logger.xpack_security_audit_deprecated_logfile.level = info
logger.xpack_security_audit_deprecated_logfile.appenderRef.deprecated_audit_rolling.ref = deprecated_audit_rolling
logger.xpack_security_audit_deprecated_logfile.additivity = false

logger.xmlsig.name = org.apache.xml.security.signature.XMLSignature
logger.xmlsig.level = error
logger.samlxml_decrypt.name = org.opensaml.xmlsec.encryption.support.Decrypter
logger.samlxml_decrypt.level = fatal
logger.saml2_decrypt.name = org.opensaml.saml.saml2.encryption.Decrypter
logger.saml2_decrypt.level = fatal

参考博客 https://blog.csdn.net/ltgsoldier1/article/details/97393154

写在最后

如果本文章对你有帮助的话，请留下你的赞

极客公园℡
关注
专栏目录
快速搭建开发环境 - Logstash
极客公园的博客
04-27 384
快速搭建开发环境 - Logstash 一、官网 官网 https://www.elastic.co/cn/logstash 下载 https://www.elastic.co/cn/downloads/logstash 二、简介 ​ Logstash 是开源的服务器端数据处理管道，能够同时从多个来源采集数据，转换数据，然后将数据发送到您最喜欢的“存储库”中。集中、转换和存储数据。 三、源码安装...
快速搭建开发环境 - Kibana
极客公园的博客
04-27 225
快速搭建开发环境 - Kibana 一、官网 官网 https://www.elastic.co/cn/kibana 下载 https://www.elastic.co/cn/downloads/kibana 二、简介 ​ 通过 Kibana，您可以对自己的 Elasticsearch 进行可视化，还可以在 Elastic Stack 中进行导航，这样您便可以进行各种操作了，从跟踪查询负载，到理...
Linux系统下安装 Elasticsearch 6.XX 外网无法访问的问题
weixin_40632733的博客
02-22 2160
  修改配置文件elasticsearch.yml [wys@elk2 elasticsearch-6.2.2]$ vim config/elasticsearch.yml      放开下面的注解 然后配置相应的内容 network.host: 172.16.1.177 #主机地址，这里写本机IP http.port: 9200 #端口   修改后，再次启动ES后，可...
laradock build elasticsearch 报错 unknown setting [cluster.initial_master_nodes] 的解决办法
逝去小时的博客
05-22 8586
Docker elasticsearch 报错 unknown setting [cluster.initial_master_nodes] 的解决办法 在 根目录 docker-compose.yml 文件中找到并删除行 - cluster.initial_master_nodes=laradock-node elasticsearch: build: ./elasticsearch volumes: - elasticsearch:/usr/share/ela
Elasticsearch踩坑日记
weixin_42687845的博客
01-14 2496
ubuntu环境下使用apt-get install elasticsearch安装es,一路掉坑，做个简单记录，避免再次踩坑。systemctl start elasticsearch 方式启动，通过 journalctl -xe 和 查看 elasticsearch日志进行排错。当前的elasticserch版本是8.6,日志默认位置在/var/log/elasticsearch/elasticsearch.log.优先使用。搜索答案，其次参考网络其他答案。
elasticsearch 7 单机配置
weixin_34391445的博客
04-18 1320
elasticsearch 7.0.0 新版更新，填个坑 单机部署提示： error1: [cluster.initial master nodes] is empty on this node error:2 the default discovery settings are unsuitable for production use; at least one of [discover...
ElasticSearch 启动 unknown setting [node] please check that any required plugins are installed
热门推荐
成长是一辈子的事
05-25 1万+
在 elasticsearch.yml 配置 node.name 的时候，启动报错，以下是配置和报错信息。 报错原因其实就是因为少了个空格！ 这是因为 yml 文件写属性值的时候必须要空格。 修改配置文件后，可成功运行： ...
es8中无法设置主节 出现unknown setting [node.master]
qq_36466946的博客
07-14 281
es8中无法设置主节 出现unknown setting [node.master] 设置node.master: true 改为：node.roles: [ master ] 其中节点的角色有多种选择 master data data_content data_hot data_warm data_cold data_frozen ingest ml remote_cluster_clien...
bboss-elasticsearch开发环境搭建和开发入门视频教程.
08-26
**Elasticsearch 开发环境搭建与 BBoss 入门教程** Elasticsearch 是一个高度可扩展的开源全文搜索引擎，设计用于快速提供近实时的搜索和分析能力。BBoss（Business Boss）是基于Elasticsearch的一个强大且灵活的...
快速搭建开发环境 - Nacos
极客公园的博客
05-07 922
快速搭建开发环境 - Nacos 官网 https://nacos.io/zh-cn/docs/use-nacos-with-springcloud.html Nacos Server 启动 停止 配置文件 nacos基础入门
elasticsearch-analysis-hanlp-7.1.1.zip
07-31
elasticsearch-analysis-hanlp-7.1.1.中文分词器，与elasticsearch7.1.1版本配合使用
ingest-geoip-6.6.0.zip
07-20
geoip主要用于kibana绘制地理区域图时使用，原理就是通过一个IP库，根据IP直接获取对应的地理坐标等信息，从而在地图上进行展示。
如何搭建 Elasticsearch-kibana 环境
08-20
搭建Elasticsearch-Kibana环境是IT运维和数据开发领域的一个常见任务，用于实现数据的存储、检索和可视化。Elasticsearch 是一个高度可扩展的开源全文搜索引擎，基于Apache Lucene构建，并且能够在大数据量下提供...
记一次Elasticsearch GeoIpDownloader的启动异常排查过程
02-06 2899
最近碰到了Elasticsearch GeoIpDownloader相关的一个异常，花费了不少精力排查，故此记录一下，希望碰到同样问题的童鞋们少走弯路。这个异常是在Elasticsearch启动的过程中报的error，如下所示，从提示信息来看是因为GeoIpDownloader更新数据库失败导致。GeoIpDownloader是用于下载地图数据库的，在更新的过程中会判断是否所有的分片都是active状态，如果不是的话会抛出这个错误。
es部署--生产环境--08--常见问题
最新发布
zhou920786312的博客
06-29 1178
原因是压缩包的内容不够完整，下载时应该在官网下载elasticsearch-analysis-ik-版本号.zip，而不是source code.zip或者elasticsearch-analysis-ansj-8.3.3.tar.gz。原因是Elasticsearch在Windows下开启了安全认证，虽然started成功，但访问http://localhost:9200/ 失败。修改 elasticsearch.yml。修改 elasticsearch.yml。
elasticsearch报错cluster.initial_master_nodes] must be configured
霓虹深处
07-30 1万+
报错 the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_master_nodes] must be configured 解决： 看配置文件el...
ElasticSearch 6.x集群搭建配置
大菠萝一号
12-17 582
简介：     ElasticSearch的集群搭建相对比较简单，有别于Solr，ElasticSearch自身带有分布式协调管理功能，而Solr是利用Zookeeper进行分布式管理的。 部署环境： 单节点环境配置：见这篇 集群名：elastice 节点信息： 系统 节点名 IP Ubuntu16.04.3 node-1 192.168.61.196 ...
elasticsearch安装 及 启动异常解决
m0_67392010的博客
09-06 678
elasticsearch 下载地址： https://www.elastic.co/cn/downloads/elasticsearch。linux 对应版本 elasticsearch-7.0.0-rc2-linux-x86_64.tar.gz 大小330 MB。这个的话，这里的node-1是上面一个默认的记得打开就可以了。7 http://ip:9200/ 无法访问。官网 ：www.elastic.co。包含 安装介质 和 权威指南。虚拟机使用net连接模式。取消注释保留一个节点。
ES集群：value for setting “discovery.zen.minimum_master_nodes“ is too low. This can result in data loss
weixin_41058733的博客
05-16 983
问题描述：     搭建Elasticsearch集群时出现以下错误      value for setting “discovery.zen.minimum_master_nodes” is too low. This can result in data loss! Please set it to at least a quorum of master-eligible nodes (current value: [1]
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值