dolphinscheduler 环境变量的配置

ChinaBiuBiuBiu

已于 2023-11-13 13:03:00 修改

阅读量873

点赞数

文章标签： docker

于 2023-11-13 11:31:20 首次发布

本文链接：https://blog.csdn.net/chinabiubiubiu/article/details/134373399

版权

使用环境:docker compose

版本:3.2.0

环境适用:java python datax 其余到有相应业务再调试

安全中心-环境变量-新建环境变量 会默认提示环境变量配置,可参照配置

export HADOOP_HOME=/opt/hadoop-2.6.5

export HADOOP_CONF_DIR=/etc/hadoop/conf

export HADOOP_CLASSPATH=`hadoop class path`

export SPARK_HOME=/opt/soft/spark

export PYTHON_LAUNCHER=/opt/soft/python/bin/python3

export JAVA_HOME=/opt/java/jdk1.8.0_181-amd64

export HIVE_HOME=/opt/soft/hive

export FLINK_HOME=/opt/soft/flink

export DATAX_LAUNCHER =/opt/soft/datax/bin/datax.py

export YARN_CONF_DIR =/etc/hadoop/conf

export PATH=$HADOOP_HOME/bin:$SPARK_HOME/bin:$PYTHON_LAUNCHER:$JAVA_HOME/bin:$HIVE_HOME/bin:$FLINK_HOME/bin:$DATAX_LAUNCHER: PATH

1.查看镜像中java环境是否存在

进入容器docker exec -it docker-dolphinscheduler-worker-1 /bin/bash

root@491a9aab058b:/opt/dolphinscheduler# echo $JAVA_HOME

/opt/java/openjdk

root@491a9aab058b:/opt/dolphinscheduler# ls $JAVA_HOME/bin/java

/opt/java/openjdk/bin/java

root@491a9aab058b:/opt/dolphinscheduler#

所以在环境变了中就使用镜像中自带的

export JAVA_HOME=/opt/java/openjdk

2.python环境指的自己本地python路径

[root@localhost shared-local]# which python3
/usr/lib/python3.11.4/bin/python3

3.datax环境下载官网文件解压到映射到本地的共享文件夹shared-local下即可