Elasticsearch集群备份恢复（S3对象存储）

1. 环境信息

IP	集群名称	http端口号	tcp端口号
192.168.2.14	es_es11223_cluster	11223	11224
192.168.2.15	es_es11223_cluster	11223	11224
192.168.2.16	es_es11223_cluster	11223	11224

2. 备份配置

2.1. 安装repository-s3插件

推荐每台es节点都安装，并重启服务：
# /data/PaaS/es/11223/bin/elasticsearch-plugin install repository-s3

2.2. JVM添加参数

在创建对象存储之前，需要在 /data/PaaS/es/11223/config/jvm.options 中添加参数：
# vim /data/PaaS/es/11223/config/jvm.options
-Des.allow_insecure_settings=true


如果不添加上述参数，会报如下错误：
{
   "type" : "repository_exception",
"reason" : "[s3_repository] failed to create repository",
"caused_by" : {
   
"type" : "illegal_argument_exception",
"reason" : "Setting [access_key] is insecure, but property [allow_insecure_settings] is not set"
}
},
"status" : 500
})

2.2. 配置访问S3账号与密码

对象存储地址：

AccessKey ID	accessKey	AccessKey Secret	secretKey	bucket	endpoint	base_path	状态
1779015880199	FP45333EZ388Y1H666D	AAAAzKRMMNN3yRu8DFVFGEEE	MMMMv1RwVlQp21NzdiiNNN7fP13gucDl2zgEEEE	justtest	http://192.168.3.254:8866	justtest	启用

2.3. 创建快照仓库

1）创建快照仓库，快照仓库名为backup：
# curl -H "Content-Type: application/json" -XPUT 'http://192.168.2.14:11223/_snapshot/backup' -d '
{
   
  "type": "s3",
  "settings": {
   
        "endpoint": "http://192.168.3.254:8866", 
        "access_key": "FP45333EZ388Y1H666D",
        "secret_key": "MMMMv1RwVlQp21NzdiiNNN7fP13gucDl2zgEEEE",
        "bucket": "justtest",
        "base_path" : "justtest",
 	    "chunk_size" : "200mb", 
        "max_restore_bytes_per_sec" : "50mb",
        "max_snapshot_bytes_per_sec" : "50mb",
        "compress": true
  }
}'



对于"endpoint"指定的IP和端口，需要可以联通：
# telnet 192.168.3.254 8866
Trying 192.168.3.254...
Connected to 192.168.3.254.
Escape character is '^]'.
^]
telnet> quit
Connection closed.


对于提供的"access_key"和"secret_key"不正确的话，会报如下错误：
{
	"error": {
		"root_cause": [{
			"type": "blob_store_exception",
			"reason": "Failed to check if blob [master.dat-temp] exists"
		}],
		"type": "blob_store_exception",
		"reason": "Failed to check if blob [master.dat-temp] exists",
		"caused_by": {
			"type": "amazon_s3_exception",
			"reason": "Forbidden (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID: tx00000000000002241b610-0060a6b117-8efa7e-default; S3 Extended Request ID: null)"
		}
	},
	"status": 500
}






2）确认备份仓库是否创建成功
# curl -H "Content-Type: application/json" -XPOST http://192.168.2.14:11223/_snapshot/backup/_verify?pretty


{
  "nodes" : {
    "c4caXoXdT1iMKt8Q0j4zvA" : {
      "name" : "192.168.2.14-11223"
    },
    "V8J66mq3ScaRtOh-b9u0Fw" : {
      "name" : "192.168.2.15-11223"
    },
    "mzRuQoWKS1qy