HDP3使用apache版Spark2.4查询hive时报错:
Caused by: java.lang.RuntimeException: org.apache.tez.dag.api.TezUncheckedException: Invalid configuration of tez jars, tez.lib.uris is not defined in the configuration
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:683)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:586)
at org.apache.spark.sql.hive.client.HiveClientImpl.newState(HiveClientImpl.scala:185)
at org.apache.spark.sql.hive.client.HiveClientImpl.<init>(HiveClientImpl.scala:118)
解决:将tez-site.xml放到/etc/hadoop/conf
conf/spark-env.sh中已包含hadoop相关配置