CDH 6.3.1/6.3.2 集成Atlas2.3.0及问题解决

CDH 6.3.1/6.3.2 集成Atlas2.3.0及问题解决

1.集成流程参考CDH 6.3.1 集成Atlas - 简书 ，写的非常详细

2.问题总结

 a. 提示找不到 restlet 相关错误

     在项目最外层的pom.xml加入

  <repository>
    <id>maven-restlet</id>
    <name>Restlet repository</name>
    <url>https://maven.restlet.talend.com</url>
  </repository>

 如下图所示：

b.编译不要用idea中的maven组件编译，直接在idea的 terminal 使用如下命令编译

mvn clean -DskipTests package -Pdist -X

c.如果是通过cdh集群部署，需要把atlas安装包分发到每一个节点，否则HiveServer2会启动报错

d.进入hive，执行sql语句，如果报以下错误，是因为hive加载不到atlas的配置文件，需要把atlas安装目录下conf文件夹中的atlas-application.properties复制到hive安装目录的conf目录。

hive> show databases;
Exception in thread "main" java.lang.ExceptionInInitializerError
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at org.apache.atlas.hive.hook.HiveHook.initialize(HiveHook.java:72)
        at org.apache.atlas.hive.hook.HiveHook.<init>(HiveHook.java:41)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at java.lang.Class.newInstance(Class.java:442)
        at org.apache.hadoop.hive.ql.hooks.HooksLoader.getHooks(HooksLoader.java:104)
        at org.apache.hadoop.hive.ql.hooks.HooksLoader.getHooks(HooksLoader.java:64)
        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1956)
        at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1563)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1339)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1328)
        at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239)
        at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:187)
        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:409)
        at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:836)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:772)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:699)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:313)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:227)
Caused by: java.lang.NullPointerException
        at org.apache.atlas.hook.AtlasHook.<clinit>(AtlasHook.java:85)
        ... 27 more
 

3.如果嫌弃编译麻烦，可以用我已经编译好的https://download.csdn.net/download/zyy8155454/87796064。