Apache Atlas 2.2版本安装

LvQiFen

已于 2022-07-21 07:48:10 修改

阅读量771

点赞数 1

分类专栏： Apache Atlas 文章标签： apache solr java

于 2022-07-20 23:38:50 首次发布

本文链接：https://blog.csdn.net/LvQiFen/article/details/125901941

版权

Apache Atlas 专栏收录该内容

1 篇文章 0 订阅

订阅专栏

Apache Atlas 2.2版本安装

即将开始做元数据管理相关的功能开发，用到了Apache Atlas 本地虚拟机里安装一个玩玩提前练练手。这里安装的是内置solr,hbase版的。记录一下安装过程

前置准备

（一）安装jdk

centOS7自带jdk，我这里卸载原生jdk，自己安装一个。

[root@localhost install-package]# rpm -aq | grep java
java-1.7.0-openjdk-1.7.0.261-2.6.22.2.el7_8.x86_64
javapackages-tools-3.4.1-11.el7.noarch
java-1.7.0-openjdk-headless-1.7.0.261-2.6.22.2.el7_8.x86_64
tzdata-java-2021e-1.el7.noarch
java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64
python-javapackages-3.4.1-11.el7.noarch
java-1.8.0-openjdk-headless-1.8.0.312.b07-1.el7_9.x86_64
[root@localhost install-package]# 
[root@localhost install-package]# 
[root@localhost install-package]# 
[root@localhost install-package]# rpm -e --nodeps java-1.8.0-openjdk-1.8.0.312.b07-1.el7_9.x86_64
[root@localhost install-package]# rpm -e --nodeps java-1.8.0-openjdk-headless-1.8.0.312.b07-1.el7_9.x86_64
[root@localhost install-package]# java -version
java version "1.7.0_261"
OpenJDK Runtime Environment (rhel-2.6.22.2.el7_8-x86_64 u261-b02)
OpenJDK 64-Bit Server VM (build 24.261-b02, mixed mode)
[root@localhost install-package]# rpm -aq | grep java
java-1.7.0-openjdk-1.7.0.261-2.6.22.2.el7_8.x86_64
javapackages-tools-3.4.1-11.el7.noarch
java-1.7.0-openjdk-headless-1.7.0.261-2.6.22.2.el7_8.x86_64
tzdata-java-2021e-1.el7.noarch
python-javapackages-3.4.1-11.el7.noarch
[root@localhost install-package]# rpm -e --nodeps java-1.7.0-openjdk-1.7.0.261-2.6.22.2.el7_8.x86_64
[root@localhost install-package]# rpm -e --nodeps java-1.7.0-openjdk-headless-1.7.0.261-2.6.22.2.el7_8.x86_64
[root@localhost install-package]# 
[root@localhost install-package]# 
[root@localhost install-package]# java -version
-bash: /usr/bin/java: No such file or directory
[root@localhost install-package]#

去Oracle官网登录下载jdk8 上传到服务器 , 这里需要注意下载的类型我是cenOS 下载的是x64 Compressed Archive 类型的。x86 x64 arm64 安装包的区别

[root@localhost install-package]# tar -zxvf jdk-8u341-linux-x64.tar.gz -C /opt/software/
[root@localhost install-package]# vim /etc/profile

末尾追加环境变量

export JAVA_HOME=/opt/software/jdk1.8.0_341
export PATH=$JAVA_HOME/bin:$PATH

再刷新资源，执行java脚本查看是否安装成功

[root@localhost install-package]# source /etc/profile
[root@localhost install-package]# 
[root@localhost install-package]# java -version
java version "1.8.0_341"
Java(TM) SE Runtime Environment (build 1.8.0_341-b10)
Java HotSpot(TM) 64-Bit Server VM (build 25.341-b10, mixed mode)

（二）Python2.X

验证当前Python 版本 centOS7 默认自带python 可以不用卸载

[root@localhost install-package]# python --version
Python 2.7.5

一、编译

编译过程中需要注意

建议最好是先在window环境下用maven编译
maven的镜像仓库特殊一点需要是阿里云的中央仓库，详情看参考资料里的 Apache Atlas 2.2版本安装参考这个博客是我同学的，apache atlas2.2版本编译好的在它的资源里面，可以免费下载使用
有条件提前下载好对应版本的 solr 和hbase 放到对应的目录下面，直接编译会下载hbase 和 solr,速度特别慢。有条件翻墙VPN的话速度会快很多，可以忽略这里，否则国内正常网络基本下载要个把小时不止… 全屏… 点点点

我这里直接给出我编译好的包: Apache Atlas 2.2.0 编译版本。下载后解压完即可按照下面的流程一步步来

二、安装

（一）解压缩

[root@localhost install-package]# pwd
/home/lvzb/common/install-package
[root@localhost install-package]# tar -zxvf apache-atlas-2.2.0-bin.tar.gz -C /opt/software/

（二）配置文件更改

配置jdk环境变量目录到 apache-atlas-2.2.0/conf/atlas-env.sh 文末追加内容：export JAVA_HOME=你的jdk安装目录

[root@localhost conf]# pwd
/opt/software/apache-atlas-2.2.0/conf
[root@localhost conf]# 
[root@localhost conf]# 
[root@localhost conf]# ll
total 68
-rw-r--r--. 1 root root 11015 Jul 20 17:14 atlas-application.properties
-rw-r--r--. 1 root root  3284 Jul 21 21:11 atlas-env.sh
-rw-r--r--. 1 root root  6308 Jul 20 17:14 atlas-log4j.xml
-rw-r--r--. 1 root root  3004 Jul 20 17:14 atlas-simple-authz-policy.json
-rw-r--r--. 1 root root 31403 Jul 20 17:14 cassandra.yml.template
-rw-r--r--. 1 root root  1401 Jul 20 17:14 hadoop-metrics2.properties
drwxr-xr-x. 2 root root    37 Jul 21 19:45 hbase
drwxr-xr-x. 3 root root   140 Jul 21 19:45 solr
-rw-r--r--. 1 root root   207 Jul 20 17:14 users-credentials.properties
drwxr-xr-x. 2 root root    54 Jul 21 19:45 zookeeper
[root@localhost conf]# 
[root@localhost conf]# vim atlas-env.sh

进入 apache-atlas-2.2.0/hbase/conf/ 在 hbase-env.sh 文末追加内容：export HBASE_MANAGES_ZK=true

[root@localhost conf]# pwd
/opt/software/apache-atlas-2.2.0/hbase/conf
[root@loca
[root@localhost conf]# 
[root@localhost conf]# vim hbase-env.sh

（三）启动`HBase`

[root@localhost bin]# pwd
/opt/software/apache-atlas-2.2.0/hbase/bin
[root@localhost bin]# 
[root@localhost bin]# 
[root@localhost bin]# ./start-hbase.sh
running master, logging to /opt/software/apache-atlas-2.2.0/hbase/bin/../logs/hbase-root-master-localhost.localdomain.out

（四）启动`Solr`

[root@localhost bin]# pwd
/opt/software/apache-atlas-2.2.0/solr/bin
[root@localhost bin]# 
[root@localhost bin]# 
[root@localhost bin]# solr start -c -z localhost:2181 -p 8984 -force
bash: solr: command not found...
[root@localhost bin]# ./solr start -c -z localhost:2181 -p 8984 -force
*** [WARN] *** Your open file limit is currently 1024.  
 It should be set to 65000 to avoid operational disruption. 
 If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
*** [WARN] ***  Your Max Processes Limit is currently 14949. 
 It should be set to 65000 to avoid operational disruption. 
 If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
Waiting up to 180 seconds to see Solr running on port 8984 [\]  
Started Solr server on port 8984 (pid=5642). Happy searching!

创建初始化 collections 不然启动图形化实例无法运行

[root@localhost bin]# pwd
/opt/software/apache-atlas-2.2.0/solr/bin
[root@localhost bin]# 
[root@localhost bin]# 
[root@localhost bin]#  bin/solr create -c vertex_index -shards 1 -replicationFactor 1 -force
-bash: bin/solr: No such file or directory
[root@localhost bin]# ./solr create -c vertex_index -shards 1 -replicationFactor 1 -force
WARNING: Using _default configset with data driven schema functionality. NOT RECOMMENDED for production use.
         To turn off: bin/solr config -c vertex_index -p 8984 -action set-user-property -property update.autoCreateFields -value false
Created collection 'vertex_index' with 1 shard(s), 1 replica(s) with config-set 'vertex_index'
[root@localhost bin]# 
[root@localhost bin]# 
[root@localhost bin]# ./solr create -c edge_index -shards 1 -replicationFactor 1 -force
WARNING: Using _default configset with data driven schema functionality. NOT RECOMMENDED for production use.
         To turn off: bin/solr config -c edge_index -p 8984 -action set-user-property -property update.autoCreateFields -value false
Created collection 'edge_index' with 1 shard(s), 1 replica(s) with config-set 'edge_index'
[root@localhost bin]# 
[root@localhost bin]# ./solr create -c fulltext_index -shards 1 -replicationFactor 1 -force
WARNING: Using _default configset with data driven schema functionality. NOT RECOMMENDED for production use.
         To turn off: bin/solr config -c fulltext_index -p 8984 -action set-user-property -property update.autoCreateFields -value false
Created collection 'fulltext_index' with 1 shard(s), 1 replica(s) with config-set 'fulltext_index'

（五）启动`Atlas`

进入bin目录执行命令等待10来秒就能启动成功了！输入 ip:21000 就能访问登录页面，初始账号密码是 admin / admin

[root@localhost bin]# pwd
/opt/software/apache-atlas-2.2.0/bin
[root@localhost bin]# 
[root@localhost bin]# ./atlas_start.py 

Configured for local HBase.
Starting local HBase...
Local HBase started!

Configured for local Solr.
Starting local Solr...
solr.xml doesn't exist in /opt/software/apache-atlas-2.2.0/data/solr, copying from /opt/software/apache-atlas-2.2.0/solr/server/solr/solr.xml
Local Solr started!

Creating Solr collections for Atlas using config: /opt/software/apache-atlas-2.2.0/conf/solr

Starting Atlas server on host: localhost
Starting Atlas server on port: 21000
...........................................................................................................................................
Apache Atlas Server started!!!

在这里插入图片描述

（六）虚拟机防火墙关闭和开启命令

遇到了主机通过 ip + 端口访问不了虚拟机的地址，排查原因发现是虚拟机的防火墙的限制。我通过禁止防火墙开机启动 + 停止防火墙。主机就能访问虚拟机了。

查看已开放的端口 : firewall-cmd --list-ports
开放端口（开放后需要要重启防火墙才生效）: firewall-cmd --zone=public --add-port=27017/tcp --permanent
重启防火墙：firewall-cmd --reload
开机启动防火墙: systemctl start firewalld
开启防火墙: systemctl start firewalld
禁止防火墙开机启动：systemctl disable firewalld
停止防火墙：systemctl stop firewalld
查看防火墙状态：systemctl status firewalld