Hadoop集群权限框架 Ranger2.1.0兼容Hadoop3.2.4部署

Ranger2.1.0源码兼容的是Hadoop3.1.0
本文章基于Hadoop3.2.4，对Ranger2.1.0做变动，打包部署，以及遇到的问题解决方案

源码修改

修改根目录 pom.xml

         <googlecode.log4jdbc.version>1.2</googlecode.log4jdbc.version>
         <gson.version>2.2.4</gson.version>
         <guice.version>4.0</guice.version>
-        <hadoop.version>3.1.1</hadoop.version>
+        <hadoop.version>3.2.4</hadoop.version>
         <ozone.version>0.4.0-alpha</ozone.version>
         <hamcrest.all.version>1.3</hamcrest.all.version>
         <hbase.version>2.0.2</hbase.version>

修改 agent-audit/pom.xml，添加commons-lang依赖，Hadoop3.2.4的依赖中剔除了hadoop3.1.0中的该依赖

+        <dependency>
+            <groupId>commons-lang</groupId>
+            <artifactId>commons-lang</artifactId>
+            <version>${commons.lang.version}</version>
+        </dependency>
        <dependency>
             <groupId>commons-logging</groupId>
             <artifactId>commons-logging</artifactId>
             <version>${commons.logging.version}</version>
        </dependency>

修改 plugin-schema-registry/pom.xml的Hadoop版本

     <properties>
-        <hadoop.version>3.1.1</hadoop.version>
+        <hadoop.version>3.2.4</hadoop.version>
         <kafka.version>2.1.0</kafka.version>
         <kafkaArtifact>kafka_2.11</kafkaArtifact>
         <jersey.version>2.22.1</jersey.version>
         <junit.version>4.5</junit.version>
         <schema.registry.version>0.8.1</schema.registry.version>

修改 security-admin/src/main/resources/conf.dist/security-applicationContext.xml

-    <security:logout delete-cookies="${ranger.admin.cookie.name}" logout-url="/logout" success-handler-ref="customLogoutSuccessHandler" />
+    <security:logout delete-cookies="RANGERADMINSESSIONID" logout-url="/logout" success-handler-ref="customLogoutSuccessHandler" />

执行打包

打包命令

mvn clean package -U -Dmaven.test.skip=true -Dmaven.artifact.checksum.skip=true

部署界面

本界面为汉化后的界面

可能遇到的问题

ranger-admin服务启动可能缺少以下包，进行拷贝

# rangeradmin下操作
cp ews/webapp/WEB-INF/lib/woodstox-core-* cred/lib/
cp ews/webapp/WEB-INF/lib/commons-lang3-3.3.2.jar cred/lib/
cp ews/webapp/WEB-INF/lib/stax2-api-3.1.4.jar cred/lib/

cp ews/webapp/WEB-INF/lib/woodstox-core-* ews/lib/
cp ews/webapp/WEB-INF/lib/stax2-api-3.1.4.jar ews/lib/
cp ews/webapp/WEB-INF/lib/commons-lang3-3.3.2.jar ews/lib/

ranger-usersnyc服务启动可能缺少以下包，进行拷贝

# ranger-usersnyc下操作
cp ../ranger-admin/ews/webapp/WEB-INF/lib/commons-lang3-3.3.2.jar lib/

ranger-tagsync服务启动可能缺少以下包，进行拷贝

ranger-tagsync下操作
cp ../ranger-admin/ews/webapp/WEB-INF/lib/commons-lang3-3.3.2.jar lib/

ranger-hive-plugin服务启动可能缺少以下包，进行拷贝

# ranger-hive-plugin下操作
cp ../ranger-2.1.0-admin/ews/webapp/WEB-INF/lib/commons-lang3-3.3.2.jar install/lib/

其他帮助命令

# 将rpm包解压成目录
rpm2cpio ranger*.rpm | cpio -idv
# 将rpm包解压成spec文件
rpmrebuild --package --notest-install --spec-only=ranger-admin.spec ranger-admin.rpm