elaticsearch集群使用hdfs备份snapshout

最新推荐文章于 2024-09-10 09:55:59 发布

fantasticqiang

最新推荐文章于 2024-09-10 09:55:59 发布

阅读量640

点赞数 1

分类专栏： elasticsearch

本文链接：https://blog.csdn.net/fantasticqiang/article/details/80466245

版权

elasticsearch 专栏收录该内容

4 篇文章 0 订阅

订阅专栏

使用es Restful api创建snapshout库的时候，老是报一下错误：

[WARN ][r.suppressed             ] path: /_snapshot/my_hdfs_repo/20161209-snapshot, params: {repository=my_hdfs_repo, snapshot=20161209-snapshot}
org.elasticsearch.transport.RemoteTransportException: [node-2][10.90.6.234:9340][cluster:admin/snapshot/create]
Caused by: org.elasticsearch.repositories.RepositoryException: [my_hdfs_repo] could not read repository data from index blob
        ......
Caused by: java.io.IOException: com.google.protobuf.ServiceException: java.security.AccessControlException: access denied ("javax.security.auth.PrivateCredentialPermission" "org.apache.hadoop.security.Credentials" "read")
         ......
Caused by: org.elasticsearch.common.io.stream.NotSerializableExceptionWrapper: service_exception: java.security.AccessControlException: access denied ("javax.security.auth.PrivateCredentialPermission" "org.apache.hadoop.security.Credentials" "read")
         ......
Caused by: java.lang.SecurityException: access denied ("javax.security.auth.PrivateCredentialPermission" "org.apache.hadoop.security.Credentials" "read")
         ......

按照网上的做法，修改es repository-hdfs插件的配置文件，结果还是不行，他们给出的方法修改“/elasticsearch-5.5.0/plugins/repository-hdfs”目录下的“plugin-security.policy”文件：

permission java.lang.RuntimePermission "accessDeclaredMembers";
  permission java.lang.RuntimePermission "getClassLoader";
  permission java.lang.RuntimePermission "shutdownHooks";
  permission java.lang.reflect.ReflectPermission "suppressAccessChecks";
  permission javax.security.auth.AuthPermission "doAs";
  permission javax.security.auth.AuthPermission "getSubject";
  permission javax.security.auth.AuthPermission "modifyPrivateCredentials";
  permission java.security.AllPermission;
  permission java.util.PropertyPermission "*", "read,write";
  permission javax.security.auth.PrivateCredentialPermission "org.apache.hadoop.security.Credentials * \"*\"", "read";

我在使用“elasticsearch”命令启动es的时候发现，es启动就报了错，报的也是这个错

access denied ("javax.security.auth.PrivateCredentialPermission" "org.apache.hadoop.security.Credentials" "read"

java本身的安全控制问题，解决方法

更改java 的安全控制文件 JRE_DIR/lib/security/java.policy

在最后一行加入:permission java.security.AllPermission

以下命令创建镜像库

curl -XPUT 'http://es02:9200/_snapshot/my_hdfs_repo?pretty' -d '
{
  "type": "hdfs",
  "settings": {
    "uri": "hdfs://es01:9000/",
    "path": "hadoop/respositories/my_hdfs_repo"
  }
}'

返回，{"acknowledged" : true}，成功