Elasticsearch 5.5.3+Kubernetes

Elasticsearch 5.5.3+Kubernetes

---

解决集群模式的elasticsearch user memlock问题

对应镜像版本：

registry.cn-hangzhou.aliyuncs.com/fugle/elasticsearch:v12

es官方提供的镜像docker.elastic.co/elasticsearch/elasticsearch:5.5.3是以elasticsearch用户作为bootstrap user，无法在容器启动时通过ulimit -l修改memlock为unlimited，导致设置bootstrap.memory_lock: true时启动失败。

需在dockerfile中使用USER root， 且在ENTRYPOINT中使用

chown -R elasticsearch:elasticsearch "$path"
exec gosu elasticsearch $@

关于镜像的source code： https://github.com/hy9418/elasticsearch.git

可直接使用我们的阿里云镜像地址

docker pull registry.cn-hangzhou.aliyuncs.com/fugle/elasticsearch:v12

---

安装插件

对应镜像版本：

registry.cn-hangzhou.aliyuncs.com/fugle/elasticsearch:v13

1. 安装x-pack、analysis-icu、analysis-phonetic、analysis-smartch

RUN elasticsearch-plugin install x-pack && \
elasticsearch-plugin install analysis-icu && \
elasticsearch-plugin install analysis-phonetic && \
elasticsearch-plugin install analysis-smartcn

2. 安装ik中文分词插件、pinyin拼音分词插件

git clone https://github.com/medcl/elasticsearch-analysis-ik.git
git clone https://github.com/medcl/elasticsearch-analysis-pinyin.git

进入项目后切换到5.5.3版本tag下编译打包

git checkout v5.5.3
mvn clean package

解压jar包到镜像中

COPY pinyin /usr/share/elasticsearch/plugins/pinyin
COPY ik /usr/share/elasticsearch/plugins/ik

---

使用configmap配置elasticsearch.yml

对应镜像版本：

registry.cn-hangzhou.aliyuncs.com/fugle/elasticsearch:v14

添加run.sh

ulimit -l unlimited
if [ -d /configmap ]; then
    for z in /configmap/*.yml; do
        cat $z >> /usr/share/elasticsearch/config/elasticsearch.yml
    done
fi
set -- elasticsearch "$@"
/docker-entrypoint.sh "$@"

• 容器启动时自动修改memlock

• configmap挂载至/configmap目录下，将*.yml文件中的值写至elasticsearch config path的yml中

• 使用elasticsearch用户启动进程

如master节点configmap：

apiVersion: v1
data:
    elasticsearch.yml: |
        cluster.name: elasticsearch-cluster
        bootstrap.memory_lock: true
        discovery.zen.ping.unicast.hosts: elasticsearch-cluster-discovery
        node.master: true
        node.data: false
        discovery.zen.minimum_master_nodes: 2
        discovery.zen.ping_timeout: 5s
        node.ingest: true
        transport.tcp.port: 9300
        transport.host: 0.0.0.0
kind: ConfigMap
metadata:
    name: elasticsearch-master-configmap
    namespace: ns-elastic

data节点configmap：

apiVersion: v1
data:
    elasticsearch.yml: |
        cluster.name: elasticsearch-cluster
        bootstrap.memory_lock: true
        discovery.zen.ping.unicast.hosts: elasticsearch-cluster-discovery
        node.master: false
        node.data: true
        node.ingest: true
        discovery.zen.ping_timeout: 5s
        transport.host: 0.0.0.0
kind: ConfigMap
metadata:
    name: elasticsearch-data-configmap
    namespace: ns-elastic

---

开始使用

集群模式

kind: Deployment
apiVersion: apps/v1beta2
metadata:
  labels:
    elastic-app: elasticsearch-cluster
    role: master
  name: elasticsearch-master
  namespace: ns-elastic
spec:
  replicas: 3
  revisionHistoryLimit: 10
  selector:
    matchLabels:
      elastic-app: elasticsearch-cluster
      role: master
  template:
    metadata:
      labels:
        elastic-app: elasticsearch-cluster
        role: master
    spec:
      containers:
        - name: elasticsearch-master
          image: registry.cn-hangzhou.aliyuncs.com/fugle/elasticsearch:v14
          volumeMounts:
          - name: elasticsearch-master-configmap
            mountPath: /configmap
          ports:
            - containerPort: 9200
              protocol: TCP
            - containerPort: 9300
              protocol: TCP
          env:
            - name: "ES_JAVA_OPTS"
              value: "-Xms512m -Xmx512m"
          securityContext:
            privileged: true
      volumes:
        - name: elasticsearch-master-configmap
          configMap:
                name: elasticsearch-master-configmap

---
kind: Service
apiVersion: v1
metadata:
  labels:
    elastic-app: elasticsearch-cluster
  name: elasticsearch-cluster-discovery
  namespace: ns-elastic
spec:
  ports:
    - port: 9300
      targetPort: 9300
  selector:
    elastic-app: elasticsearch-cluster
    role: master

---
kind: Deployment
apiVersion: apps/v1beta2
metadata:
  labels:
    elastic-app: elasticsearch-cluster
    role: data
  name: elasticsearch-data
  namespace: ns-elastic
spec:
  replicas: 1
  revisionHistoryLimit: 10
  selector:
    matchLabels:
      elastic-app: elasticsearch-cluster
  template:
    metadata:
      labels:
        elastic-app: elasticsearch-cluster
        role: data
    spec:
      containers:
        - name: elasticsearch-data
          image: registry.cn-hangzhou.aliyuncs.com/fugle/elasticsearch:v14
          ports:
            - containerPort: 9200
              protocol: TCP
            - containerPort: 9300
              protocol: TCP
          volumeMounts:
            - name: elasticsearch
              mountPath: /usr/share/elasticsearch/data
            - name: elasticsearch-data-configmap
              mountPath: /configmap
          env:
            - name: "ES_JAVA_OPTS"
              value: "-Xms512m -Xmx512m"
          securityContext:
            privileged: true
      volumes:
        - name: elasticsearch
          emptyDir: {}
        - name: elasticsearch-data-configmap
          configMap:
                name: elasticsearch-data-configmap

---
kind: Service
apiVersion: v1
metadata:
  labels:
    elastic-app: elasticsearch-cluster-nodeport
  name: elasticsearch-cluster-nodeport
  namespace: ns-elastic
spec:
  ports:
    - port: 9200
      targetPort: 9200
  selector:
    elastic-app: elasticsearch-cluster
  type: NodePort

单点模式

kind: Deployment
apiVersion: apps/v1beta2
metadata:
  labels:
    elastic-app: elasticsearch-simple
  name: elasticsearch-simple
  namespace: ns-elastic
spec:
  replicas: 1
  revisionHistoryLimit: 4
  selector:
    matchLabels:
      elastic-app: elasticsearch-simple
  template:
    metadata:
      labels:
        elastic-app: elasticsearch-simple
    spec:
      containers:
        - name: elasticsearch-simple
          image: registry.cn-hangzhou.aliyuncs.com/fugle/elasticsearch:v13
          ports:
            - containerPort: 9200
              protocol: TCP
            - containerPort: 9300
              protocol: TCP
          volumeMounts:
            - name: elasticsearch-simple
              mountPath: /usr/share/elasticsearch/data
          env:
            - name: "ES_JAVA_OPTS"
              value: "-Xms512m -Xmx512m"
          securityContext:
            privileged: true
      volumes:
        - name: elasticsearch-simple
          persistentVolumeClaim:
                claimName: elasticsearch-simple
---
kind: Service
apiVersion: v1
metadata:
  labels:
    elastic-app: elasticsearch-simple
  name: elasticsearch-simple
  namespace: ns-elastic
spec:
  ports:
    - port: 9300
      targetPort: 9300
  selector:
    elastic-app: elasticsearch-simple
---
kind: Service
apiVersion: v1
metadata:
    labels:
        elastic-app: elasticsearch-simple-nodeport
    name: elasticsearch-simple-nodeport
    namespace: ns-elastic
spec:
    ports:
    - port: 9200
      targetPort: 9200
    selector:
      elastic-app: elasticsearch-simple
    type: NodePort

注：imagePullSecret、namespace、pv等对象这里不再复述