DataSophon组件之Flink升级

1.解压新旧组件安装包

安装包:

Index of /apache

cd  /opt/datasophon/DDP/packages

tar  zxvf  flink-1.16.2.tar.gz  -C  /opt/datasophon/DDP/packages

2.修改安装包中文件和目录

cd  /opt/datasophon/DDP/packages

chown  -R root:root  flink-1.16.2

3.重新生成安装包

1>重新打包

cd  /opt/datasophon/DDP/packages

mv flink-1.16.2.tar.gz  flink-1.16.2.tar.gz.bak   -- 备份

tar czf  flink-1.16.2.tar.gz   flink-1.16.2      -- 重新打包

2>生成加密码

md5sum flink-1.16.2.tar.gz

3>生成md5加密文件

echo '8d9ee35827dd3fbb758bf592c27bdbd4' > flink-1.16.2.tar.gz.md5

4.删除已装的组件包flink(ALL)

rm -rf  /opt/datasophon/flink*

5.修改service_ddl.json

cd   /opt/datasophon/DDP/packages/datasophon-manager-1.1.3/conf/meta/DDP-1.1.3/

vi   /opt/datasophon/DDP/packages/datasophon-manager-1.1.3/conf/meta/DDP-1.1.3/FLINK/service_ddl.json

*datasophon-manager-1.1.3 为当前的datasohon安装版本,可能多处地方需要修改 

6.修改env环境变量(ALL)

1>修改环境变量配置参数(ALL)

vi   /etc/profile.d/datasophon-env.sh

echo  ${FLINK_HOME}

2>生效环境变量

  source  /etc/profile

  echo  ${FLINK_HOME}

3>重启服务器

reboot

echo ${HADOOP_HOME}

*不重启HADOOP_HOME的环境变量安装时还是不生效

4>重启manager服务

rm -rf   /opt/datasophon/DDP/packages/datasophon-manager-1.1.3/logs/*

/opt/datasophon/DDP/packages/datasophon-manager-1.1.3/bin/datasophon-api.sh restart api

cd /opt/datasophon/DDP/packages/datasophon-manager-1.1.3/logs

  

  查看相应的表配置数据

   select * from t_ddh_frame_service;

   select * from t_ddh_frame_service_role;

7.重新安装服务

8.测试验证

export HADOOP_CLASSPATH=`hadoop classpath`

bin/flink run -m yarn-cluster ./examples/batch/WordCount.jar

集群提交，日志需要在yarn上查看