DolphinScheduler相关问题

1、数据源中心连接hive报错

查看日志/opt/apache-dolphinscheduler-3.1.7/api-server/logs/dolphinscheduler-api.log
报如下错误

上述日志报错原因为hive jar包跟集群版本不一致导致

以下操作39 40 41三台服务器均需要执行，替换完jar包后重启dolphinscheduler即可

/opt/apache-dolphinscheduler-3.1.7/api-server

/opt/apache-dolphinscheduler-3.1.7/master-server

/opt/apache-dolphinscheduler-3.1.7/worker-server

上述三个目录lib中所有hive的jar全部替换

先备份：

mv hive-common-2.3.9.jar hive-common-2.3.9.jar.bak
mv hive-jdbc-2.3.9.jar hive-jdbc-2.3.9.jar.bak
mv hive-metastore-2.3.9.jar hive-metastore-2.3.9.jar.bak
mv hive-serde-2.3.9.jar hive-serde-2.3.9.jar.bak
mv hive-service-2.3.9.jar hive-service-2.3.9.jar.bak
mv hive-service-rpc-2.3.9.jar hive-service-rpc-2.3.9.jar.bak
mv hive-storage-api-2.4.0.jar hive-storage-api-2.4.0.jar.bak

将集群hive jar包复制到DolphinScheduler各个服务的lib目录下：

cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-common-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/api-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-jdbc-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/api-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-metastore-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/api-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-serde-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/api-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-service-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/api-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-service-rpc-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/api-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-storage-api-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/api-server/libs


cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-common-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/master-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-jdbc-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/master-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-metastore-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/master-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-serde-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/master-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-service-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/master-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-service-rpc-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/master-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-storage-api-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/master-server/libs


cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-common-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/worker-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-jdbc-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/worker-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-metastore-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/worker-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-serde-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/worker-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-service-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/worker-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-service-rpc-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/worker-server/libs
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-storage-api-2.1.1-cdh6.3.2.jar /opt/apache-dolphinscheduler-3.1.7/worker-server/libs