【ELK】elasticsearch的snapshot快照备份

• 备份数据

  任何一个存储数据的软件,都需要定期备份数据。es replica提供 了运行时的高可用机制,可以容忍少数节点故障和部分数据丢失, 但是整体上却不会丢失任何数据,而不会影响集群的运行。但是replica没法进行灾难性的数据保护,比如机房彻底停电,所有机器全部宕机等情况。

  对于这种灾难性故障,就需要对数据进行备份。比如人为drop

• 快照功能

  要备份集群数据,就要用到snapshot api,这个api会将当前集群的 状态和数据全部存储到一个外部的共享目录中去,比如 NAS,HDFS,S3,NFS。

  这个快照过程是增量的,第一次会备份全量数据,后面就是增量数据了。

• 注册仓库

  设置:
  path.repo: ["/es/backup"]
  
  PUT /_snapshot/my_backup
  {
    "type": "fs",
    "settings": {
      "location": "my_backup_location"
    }
  }
  #会在/es/backup目录创建一个名为my_backup_location的目录
  
  PUT /_snapshot/my_backup2
  {
    "type": "fs",
    "settings": {
      "location": "my_backup_location2"
    }
  }
  #会在/es/backup目录创建一个名为my_backup_location2的目录
  
  #查看仓库
  GET /_snapshot/my_backup
  
  #查看所有仓库
  GET /_snapshot     GET /_snapshot/_all
  
  #删除仓库
  DELETE /_snapshot/my_backup2
  #并不会删除文件,只是取消了引用
  

• 创建快照

  #备份所有索引(创建快照)
  PUT /_snapshot/my_backup/snapshot_1?wait_for_completion=true
  #返回结果:
  {
    "snapshot" : {
      "snapshot" : "snapshot_1",
      "uuid" : "2DM1B31ESpKppxyCp-Gbkg",
      "version_id" : 7080099,
      "version" : "7.8.0",
      "indices" : [
        ".kibana_1",
        "fxindex01",
        "fxindex03",
        ".apm-agent-configuration",
        "fxindex02",
        ".kibana-event-log-7.8.0-000001",
        ".kibana_task_manager_1",
        ".apm-custom-link",
        "ilm-history-2-000001"
      ],
      "include_global_state" : true,
      "state" : "SUCCESS",
      "start_time" : "2021-03-01T01:31:55.570Z",
      "start_time_in_millis" : 1614562315570,
      "end_time" : "2021-03-01T01:31:55.971Z",
      "end_time_in_millis" : 1614562315971,
      "duration_in_millis" : 401,
      "failures" : [ ],
      "shards" : {
        "total" : 9,
        "failed" : 0,
        "successful" : 9
      }
    }
  }
  
  #备份指定索引
  PUT /_snapshot/my_backup/snapshot_2?wait_for_completion=true
  {
    "indices": "fxindex01,fxindex02",
    "ignore_unavailable": true,
    "include_global_state": false,
    "metadata": {
      "taken_by": "kimchy",
      "taken_because": "backup before upgrading"
   }
  }
  

• 恢复快照

  POST /_snapshot/my_backup/snapshot_2/_restore
  {
    "indices": "kibana_sample_data_logs",
    "ignore_unavailable": true,
    "include_global_state": false,              
    "rename_pattern": "kibana_(.+)",
    "rename_replacement": "restored_kibana_$1",
    "include_aliases": false
  }
  POST /_snapshot/my_backup/snapshot_2/_restore
  {
    "indices": "kibana_sample_data_logs",
    "ignore_unavailable": true,
    "include_global_state": false,              
    "include_aliases": false
  }
  

• 删除快照

  #删除快照会删除文件
  DELETE /_snapshot/my_backup/snapshot_1
  DELETE /_snapshot/my_backup/snapshot_2,snapshot_3
  DELETE /_snapshot/my_backup/snap*
  

• 查看状态

  #查看运行中的快照
  GET /_snapshot/my_backup/_current
  #查看仓库中有多少个快照
  GET /_snapshot/my_backup/_all
  #查看快照信息
  GET /_snapshot/my_backup/snapshot_1
  #查看运行中快照的状态
  GET /_snapshot/_status
  #查看快照详细状态
  GET /_snapshot/my_backup/snapshot_1/_status
  

• 快照恢复查看

  #索引恢复状态查询
  GET /_recovery
  GET /restored_kibana_sample_data_logs/_recovery
  
  GET /_cat/recovery?v
  GET /_cat/recovery/restored_kibana_sample_data_logs?v