背景
insert overwrite table a
select
u.unionid
from
b
inner join u on b.uid = u.id;
用Spark,连接u表和b表关联后插入a表
报错内容
[ERROR] 2024-03-05 17:07:01.018 +0800 - execute sql error: org.apache.hive.service.cli.HiveSQLException: Error running query: org.apache.spark.sql.AnalysisException: Cannot read table property 'spark.sql.sources.schema' as it's corrupted.
at org.apache.spark.sql.hive.thriftserver.HiveThriftServerErrors$.runningQueryError(HiveThriftServerErrors.scala:43)
at org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.org$apache$spark$sql$hive$thriftserver$SparkExecuteStatementOperation$$execute(SparkExecuteStatementOperation.scala:325)
原因
u表和b表的表结构有问题,查询count(1)后发现也报错Cannot read table property 'spark.sql.sources.schema,建表SQL调整后就可以了