记一次Spark ThriftServer Bug排查

问题描述

我们在用Spark ThriftServer（以下简称STS）用在查询平台时，遇到了以下报错：

ERROR SparkExecuteStatementOperation: Error executing query, currentState RUNNING,
org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to move source hdfs://nameservice1/tmp/hive/spark-root_hive_2019-06-28_14-43-11_836_5887471809974605195-2/-ext-10000/part-00000-8dbc4e2a-5844-4c44-bf55-8983b49be8b2-c000.snappy to destination hdfs://nameservice1/user/hive/warehouse/test.db/zyz/part-00000-8dbc4e2a-5844-4c44-bf55-8983b49be8b2-c000.snappy;
	at org.apache.spark.sql.hive.HiveExternalCatalog.withClient(HiveExternalCatalog.scala:106)
	at org.apache.spark.sql.hive.HiveExternalCatalog.loadTable(HiveExternalCatalog.scala:843)
	at org.apache.spark.sql.catalyst.catalog.ExternalCatalogWithListener.loadTable(ExternalCatalogWithListener.scala:159)

无法移动文件，有种可能是因为起服务的用户在hdfs上没有相应的文件操作权限，但这个case不是，继