【报错】Caused by: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writabl

已于 2024-03-11 17:57:46 修改
阅读量988 收藏 18
点赞数 20
分类专栏： 报错 文章标签： spark
于 2024-03-04 10:03:56 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/weixin_61070671/article/details/136444274
版权

Exception in thread "main" org.apache.spark.sql.AnalysisException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: ---------
    at org.apache.spark.sql.hive.HiveExternalCatalog.withClient(HiveExternalCatalog.scala:112)
    at org.apache.spark.sql.hive.HiveExternalCatalog.databaseExists(HiveExternalCatalog.scala:224)
    at org.apache.spark.sql.internal.SharedState.externalCatalog$lzycompute(SharedState.scala:134)
    at org.apache.spark.sql.internal.SharedState.externalCatalog(SharedState.scala:124)
    at org.apache.spark.sql.internal.SharedState.globalTempViewManager$lzycompute(SharedState.scala:154)
    at org.apache.spark.sql.internal.SharedState.globalTempViewManager(SharedState.scala:152)
    at org.apache.spark.sql.hive.HiveSessionStateBuilder.$anonfun$catalog$2(HiveSessionStateBuilder.scala:60)
    at org.apache.spark.sql.catalyst.catalog.SessionCatalog.globalTempViewManager$lzycompute(SessionCatalog.scala:99)
    at org.apache.spark.sql.catalyst.catalog.SessionCatalog.globalTempViewManager(SessionCatalog.scala:99)
    at org.apache.spark.sql.catalyst.catalog.SessionCatalog.lookupGlobalTempView(SessionCatalog.scala:870)
    at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveTempViews$.lookupTempView(Analyzer.scala:915)
    at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveTempViews$$anonfun$apply$7.applyOrElse(Analyzer.scala:875)
    at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveTempViews$$anonfun$apply$7.applyOrElse(Analyzer.scala:873)
    at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUp$3(AnalysisHelper.scala:90)
    at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:73)
    at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUp$1(AnalysisHelper.scala:90)
    at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.allowInvokingTransformsInAnalyzer(AnalysisHelper.scala:221)
    at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUp(AnalysisHelper.scala:86)
    at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsUp$(AnalysisHelper.scala:84)
    at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperatorsUp(LogicalPlan.scala:29)
    at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveTempViews$.apply(Analyzer.scala:873)
    at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveRelations$.apply(Analyzer.scala:1102)
    at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveRelations$.apply(Analyzer.scala:1070)
    at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$2(RuleExecutor.scala:216)
    at scala.collection.LinearSeqOptimized.foldLeft(LinearSeqOptimized.scala:126)
    at scala.collection.LinearSeqOptimized.foldLeft$(LinearSeqOptimized.scala:122)
    at scala.collection.immutable.List.foldLeft(List.scala:89)
    at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1(RuleExecutor.scala:213)
    at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1$adapted(RuleExecutor.scala:205)
    at scala.collection.immutable.List.foreach(List.scala:392)
    at org.apache.spark.sql.catalyst.rules.RuleExecutor.execute(RuleExecutor.scala:205)
    at org.apache.spark.sql.catalyst.analysis.Analyzer.org$apache$spark$sql$catalyst$analysis$Analyzer$$executeSameContext(Analyzer.scala:196)
    at org.apache.spark.sql.catalyst.analysis.Analyzer.execute(Analyzer.scala:190)
    at org.apache.spark.sql.catalyst.analysis.Analyzer.execute(Analyzer.scala:155)
    at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$executeAndTrack$1(RuleExecutor.scala:183)
    at org.apache.spark.sql.catalyst.QueryPlanningTracker$.withTracker(QueryPlanningTracker.scala:88)
    at org.apache.spark.sql.catalyst.rules.RuleExecutor.executeAndTrack(RuleExecutor.scala:183)
    at org.apache.spark.sql.catalyst.analysis.Analyzer.$anonfun$executeAndCheck$1(Analyzer.scala:174)
    at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.markInAnalyzer(AnalysisHelper.scala:228)
    at org.apache.spark.sql.catalyst.analysis.Analyzer.executeAndCheck(Analyzer.scala:173)
    at org.apache.spark.sql.execution.QueryExecution.$anonfun$analyzed$1(QueryExecution.scala:73)
    at org.apache.spark.sql.catalyst.QueryPlanningTracker.measurePhase(QueryPlanningTracker.scala:111)
    at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$1(QueryExecution.scala:143)
    at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:772)
    at org.apache.spark.sql.execution.QueryExecution.executePhase(QueryExecution.scala:143)
    at org.apache.spark.sql.execution.QueryExecution.analyzed$lzycompute(QueryExecution.scala:73)
    at org.apache.spark.sql.execution.QueryExecution.analyzed(QueryExecution.scala:71)
    at org.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:63)
    at org.apache.spark.sql.Dataset$.$anonfun$ofRows$1(Dataset.scala:90)
    at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:772)
    at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:88)
    at org.apache.spark.sql.DataFrameReader.table(DataFrameReader.scala:892)
    at caiji.lixian_lixian$.text01(lixian_lixian.scala:36)
    at caiji.lixian_lixian$.main(lixian_lixian.scala:12)
    at caiji.lixian_lixian.main(lixian_lixian.scala)
Caused by: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: ---------
    at org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:724)
    at org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:654)
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:586)
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:548)
    at org.apache.spark.sql.hive.client.HiveClientImpl.newState(HiveClientImpl.scala:174)
    at org.apache.spark.sql.hive.client.HiveClientImpl.<init>(HiveClientImpl.scala:129)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at org.apache.spark.sql.hive.client.IsolatedClientLoader.createClient(IsolatedClientLoader.scala:293)
    at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:492)
    at org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:352)
    at org.apache.spark.sql.hive.HiveExternalCatalog.client$lzycompute(HiveExternalCatalog.scala:71)
    at org.apache.spark.sql.hive.HiveExternalCatalog.client(HiveExternalCatalog.scala:70)
    at org.apache.spark.sql.hive.HiveExternalCatalog.$anonfun$databaseExists$1(HiveExternalCatalog.scala:224)
    at scala.runtime.java8.JFunction0$mcZ$sp.apply(JFunction0$mcZ$sp.java:23)
    at org.apache.spark.sql.hive.HiveExternalCatalog.withClient(HiveExternalCatalog.scala:102)
    ... 54 more

增加 

    .config("hive.exec.scratchdir", "hdfs://bigdata1:9820/user/hive/tmp")


                

        

        

    

  


    

      

        

            

              
                
                  莫噶
                
              
            

            

                关注
              
            

        

        

          
      

      

            

                专栏目录
          









                



	

		

			

				
					
hive启动报错：Caused by: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be

				
			

			

				

					Johnmay--Blog
				

				

					02-17
					
					2989
					
				

			

		

		

			
				
[root@slave bin]# ./hive
17/02/17 23:27:57 WARN conf.HiveConf: HiveConf of name hive.metastore.local does not exist
Logging initialized using configuration in file:/home/hadoop/hive-1.2.1/conf/hive-

			
		

	



                

              
                



	

		

			

				
					
windows部署spark:The root scratch dir: /tmp/hive on HDFS should be writable.

				
			

			

				

					dfyBlog的博客
				

				

					08-21
					
					830
					
				

			

		

		

			
				
目录1.安装jdk2.安装hadoop3.安装Scala4.安装spark5.idea集成Scala5.1 idea安装Scala插件5.2 安装Scala SDK
1.安装jdk


配置环境变量
JAVA_HOME:D:\java\jdk1.8.0_31
PATH:%JAVA_HOME%\bin;%JAVA_HOME%\jre\bin
CLASSPATH:.;%JAVA_HOME%\lib;%...

			
		

	



                


  
              

                


	

		

			

				
					
Caused by: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

				
			

			

				

					liangsw
				

				

					06-26
					
					1855
					
				

			

		

		

			
				
一、启动HIVE报错：


[root@master ~]# hive

Logging initialized using configuration in jar:file:/usr/local/hive-1.2.2/lib/hive-common-1.2.2.jar!/hive-log4j.properties
Exception in thread "main" java.lang.Run...

			
		

	





	

		

			

				
					
java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

				
			

			

				

					红叶的博客
				

				

					11-20
					
					1354
					
				

			

		

		

			
				
Exception in thread “main” java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx------
启动 Hive 时报错
[root@node01 hive-1.1.0-cdh5.14.0]# bin/hive
which: no hbase in (/usr/lib64/qt-3.3/bin::/expor

			
		

	



		

			
		



	

		

			

				
					
Caused by:java.lang.RuntimeException:The root scratch dir:/tmp/hive on HDFS should be writable.

				
			

			

				

					zlpzlr的博客
				

				

					01-09
					
					4140
					
				

			

		

		

			
				
解决办法：


hadoop fs -rm -r /tmp/hive;  
rm -rf /tmp/hive


Only temporary files are kept in this location. No problem even if we delete this, will be created when required with proper permissions

			
		

	





	

		

			

				
					
windows上Caused by: java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tm

				
			

			

				

					留歌__36的博客
				

				

					02-08
					
					968
					
				

			

		

		

			
				
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rw-rw-rw-
参照这个开始解决：


You will also notice that ...

			
		

	





	

		

			

				
					
在idea运行scala程序报错：The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are

				
			

			

				

					qq_37023928的博客
				

				

					05-10
					
					684
					
				

			

		

		

			
				
在idea运行scala程序报错：Error while instantiating 'org.apache.spark.sql.hive.HiveSessionState': java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: ---------
解决方式：
%HADOOP_HOME%\bin\winutils.exe chmod 7

			
		

	





	

		

			

				
					
Hive启动问题的解决办法：Exception in thread "main"java.lang.RuntimeException: java.lang.RuntimeException（已解决)

					
热门推荐

				
			

			

				

					艳阳如一
				

				

					07-01
					
					3万+
					
				

			

		

		

			
				
文章目录1.错误显示错误原因解决方法解决后hive的成功启动效果图
1.错误显示
     Exception in thread "main"java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir:/tmp/hive on HDFS should be writable.
   Current pe...

			
		

	





	

		

			

				
					
Sqoop将Oracle数据导入Hive时出现异常 running import job: java.io.IOException: Hive exited with status 1

				
			

			

				

					舒克的博客
				

				

					03-30
					
					6970
					
				

			

		

		

			
				
[root@node2 sqoop-1.4.6]# sqoop import --connect jdbc:oracle:thin:@192.168.8.110:1521:orcl --username SKY --password 123456 --table GJJY20150613 -m 8 --hive-import
Warning: /home/sqoop-1.4.6//../hcat

			
		

	





	

		

			

				
					
spark 应用程序访问hive异常问题

				
			

			

				

					ljw714的专栏
				

				

					05-08
					
					729
					
				

			

		

		

			
				
开发spark应用程序在本地启动时，报异常

Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx------...

			
		

	





	

		

			

				
					
解决windows上The root scratch dir: /tmp/hive on HDFS should be writable.Current permissions are: ------

				
			

			

				

					heccxx的博客
				

				

					11-02
					
					3551
					
				

			

		

		

			
				
解决Error while instantiating 'org.apache.spark.sql.hive.HiveSessionState': java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: ---------

首先...

			
		

	





	

		

			

				
					
在运行hive的时候出现的问题

				
			

			

				

					温润如风的博客
				

				

					05-05
					
					1974
					
				

			

		

		

			
				
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions
 are: rwx-wx--x
    at org.apache.h

			
		

	





	

		

			

				
					
在idea运行spark程序报错：The root scratch dir: /tmp/hive on HDFS should be writable

				
			

			

				

					penriver的博客
				

				

					03-03
					
					2535
					
				

			

		

		

			
				
win10个人电脑，在idea中运行spark程序【连接了hive】，报如下异常：java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: r--r--r--; 
本文针对此问题进行了分析并提供了解决方案。

			
		

	





	

		

			

				
					
spark-shell连接异常问题

				
			

			

				

					哈尔科夫坦克厂的播客
				

				

					11-05
					
					713
					
				

			

		

		

			
				

[root@node00 sbin]# /apps/spark-2.2.0-bin-hadoop2.7/bin/spark-shell --master spark://node00:7077
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log le...

			
		

	





	

		

			

				
					
RuntimeException: root scratch dir: /tmp/hive在HDFS上应该是可写的。当前权限为:rwx——

				
			

			

				

					weixin_44519124的博客
				

				

					04-26
					
					1863
					
				

			

		

		

			
				
Logging initialized using configuration in jar:file:/export/servers/hive-1.1.0-cdh5.14.0/lib/hive-common-1.1.0-cdh5.14.0.jar!/hive-log4j.properties Exception in thread "main" java.lang.RuntimeExcep...

			
		

	





	

		

			

				
					
启动Hive时出现错误：/tmp/hive on HDFS should be writable. Current permissions are: rwx------

				
			

			

				

					weixin_50213935的博客
				

				

					11-26
					
					972
					
				

			

		

		

			
				
启动Hive时出现错误：/tmp/hive on HDFS should be writable. Current permissions are: rwx------

如出现以上错误时，这是/tmp/hive目录权限不够，需要提升权限
操作如下命令即可解决问题：
删除HDFS的tmp目录
或hadoop fs -chmod -R 777 /tmp

...

			
		

	





	

		

			

				
					
azkaban 与 java任务_azkaban任务报错java.lang.RuntimeException: The root scratch dir: /tmp/hive...

				
			

			

				

					weixin_35867894的博客
				

				

					02-23
					
					253
					
				

			

		

		

			
				
azkaban运行任务的时候失败报错如下：23-03-2016 08:16:14 CST analyzer-kafka2hdfs_new ERROR - Exception in thread "main" org.apache.hive.service.cli.HiveSQLException: java.lang.RuntimeException: The root scratch dir: ...

			
		

	





	

		

			

				
					
hive client 登录报权限不足问题/tmp/hive on HDFS should be writable. Current permissions are: rwx------

				
			

			

				

					qq_41018861的博客
				

				

					07-18
					
					1224
					
				

			

		

		

			
				
今早同事突然说，hive在服务器登录不上去了，报权限问题。集群一直好好的怎么报权限问题呢个？笔者问了问情况，了解到原来该同事是看tmp目录下存储的较多的数据觉得浪费空间所以清理了/tmp。为了帮助新同事萌了解问题提供解决思路，首先这个问题比较简单，添加权限就可以，明白tmp下目录信息，特此记录。............

			
		

	





	

		

			

				
					
The root scratch dir: tmp/hive on HDFS should be writable. Current permissions are: rw-rw-rw-

				
			

			

				

					weixin_43995212的博客
				

				

					06-17
					
					661
					
				

			

		

		

			
				
The root scratch dir: tmp/hive on HDFS should be writable. Current permissions are: rw-rw-rw-

			
		

	





	

		

			

				
					
sqoop 报错Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang.StringUtils

					
最新发布

				
			

			

				

					03-11
				

			

		

		

			
				
sqoop报错Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang.StringUtils是由于缺少org.apache.commons.lang.StringUtils类所在的jar包导致的。根据提供的引用内容，可以看出sqoop的lib目录下...

			
		

	



              




          




        



    





    



      

      

        
      

      





	

		评论	
	

	
	




  

    

      添加红包
      
    

    

      

        
        

          
          
        

        
请填写红包祝福语或标题

      

      

        
        

          
          个
        

        
红包个数最小为10个

      

      

        
        

          
          元
        

        
红包金额最低5元

      

      

        
        

          当前余额3.43元
          前往充值 >
        

      

      

        

          需支付：10.00元
        

        
        
      

    

  





  

    
    
  

  

    
    
  








  

    

      

        

          

            
            
成就一亿技术人!

          

          

        

        

          

          

            领取后你会自动成为博主和红包主的粉丝
            规则
          

        

      

      

        

          

            
              
            
            

              
hope_wisdom
 发出的红包
            

          

        

        

          

          

          

        

      

    

    

  



      
      

      
实付元

      
使用余额支付

      

        

          

            
            点击重新获取
          

        

        
扫码支付

      

      

        
          
            
          
          
        
      

      

        
        钱包余额
          0
          

            
            

              

                
抵扣说明：

                
 1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
 2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

              

            

          

      

      余额充值