The root scratch dir: tmp/hive on HDFS should be writable. Current permissions are: rw-rw-rw-

最新推荐文章于 2024-03-04 10:03:56 发布
最新推荐文章于 2024-03-04 10:03:56 发布
阅读量626 收藏
点赞数
分类专栏： spark hadoop 文章标签： hive hdfs spark
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/weixin_43995212/article/details/125333564
版权

#本地运行spark程序报错

Caused by: java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: tmp/hive on HDFS should be writable. Current permissions are: rw-rw-rw-
	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
	at org.apache.spark.sql.hive.client.HiveClientImpl.<init>(HiveClientImpl.scala:188)
	... 38 more
Caused by: java.lang.RuntimeException: The root scratch dir: tmp/hive on HDFS should be writable. Current permissions are: rw-rw-rw-
	at org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:612)
	at org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:554)
	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:508)
	... 39 more

解决方法：加上hdfs路径
在这里插入图片描述

  <property>
      <name>hive.exec.scratchdir</name>
      <value>hdfs://hdp1:8020/tmp/hive</value>
    </property>
keeper&
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
解决 The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwxr-xr-x
m0_52184330的博客
11-15 4407
问题描述： spark 将数据写入到hive表时 报错： The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwxr-xr-x 如下图： 原因分析： 从The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwxr-xr-x 可以看出，系统要求再hdfs上用户要具备写的权
spark-shell连接异常问题
哈尔科夫坦克厂的播客
11-05 680
[root@node00 sbin]# /apps/spark-2.2.0-bin-hadoop2.7/bin/spark-shell --master spark://node00:7077 Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties Setting default log le...
sparksql 读取、连接 hive 报The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions
qq_42044006的博客
03-02 2432
sparksql 读取、连接 hive 报The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions 首先检查权限问题，这里有两种解决方式： 1.用有写权限的用户去操作：在代码中添加环境变量：System.setProperty("HADOOP_USER_NAME","hadoop") 2.其次检查 hdfs /tmp/hive 其他用户是否对其有写的权限，如果没有就用该目录拥有者账户执行hadoop
Caused by: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.
liangsw
06-26 1823
一、启动HIVE报错： [root@master ~]# hive Logging initialized using configuration in jar:file:/usr/local/hive-1.2.2/lib/hive-common-1.2.2.jar!/hive-log4j.properties Exception in thread "main" java.lang.Run...
java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.
红叶的博客
11-20 1343
Exception in thread “main” java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx------ 启动 Hive 时报错 [root@node01 hive-1.1.0-cdh5.14.0]# bin/hive which: no hbase in (/usr/lib64/qt-3.3/bin::/expor
解决scratch3.0scratch-hex文件下载失败问题
08-09
scratch-gui在npm安装过程中出现下载不到scratch-hex文件的问题解决方案
scratch-telegram-bot:使用scratch.mit.edu创建Telegram机器人（概念验证）
05-04
临时电报机器人使用scratch.mit.edu创建Telegram机器人（概念验证） :warning: 使用eval块时要小心，因为您正在计算机上执行Python代码。要求Python 3.6或更高版本浏览器扩展如何使用$ python -m pip install -r ...
scratch-image-uploader:使用 Scratch 项目缩略图上传要在论坛上使用的图像
05-31
在 Scratch Addons 中，它已重命名为“论坛图片上传器” 此存储库保留为存档，并在 Scratch Addons 中报告新版本插件的错误 :file_folder: 从头图片上传chrome(ium) 扩展，允许从头开始直接上传图像 :floppy_disk: ...
ppm2.rar_https://ppm2.com_ppm image_ppm2----com_www. ppm 2.com_w
07-15
Graphic software programs, which can be broadly grouped into vector graphics editors, raster graphics editors, and 3D modelers, are the primary tools with which a user may manipulate, enhance, and ...
arm-2014.05-29-arm-none-linux-gnueabi
01-28
COLLECT_LTO_WRAPPER=d:/eclipse/cross/arm-2014.05-29/bin/../libexec/gcc/arm-none-linux-gnueabi/4.8.3/lto-wrapper.exe Target: arm-none-linux-gnueabi Configured with: /scratch/maciej/arm-linux-2014.05-...
在idea运行spark程序报错：The root scratch dir: /tmp/hive on HDFS should be writable
penriver的博客
03-03 2512
win10个人电脑，在idea中运行spark程序【连接了hive】，报如下异常：java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: r--r--r--; 本文针对此问题进行了分析并提供了解决方案。
windows上Caused by: java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tm
留歌__36的博客
02-08 961
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rw-rw-rw- 参照这个开始解决： You will also notice that ...
Caused by:java.lang.RuntimeException:The root scratch dir:/tmp/hive on HDFS should be writable.
zlpzlr的博客
01-09 4131
解决办法： hadoop fs -rm -r /tmp/hive;   rm -rf /tmp/hive Only temporary files are kept in this location. No problem even if we delete this, will be created when required with proper permissions
【报错】Caused by: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writabl
最新发布
weixin_61070671的博客
03-04 942
【代码】【报错】Caused by: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writabl。
进入hive时线程“main”java.lang的异常权限不够
wmz960708581的博客
09-13 862
Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx------ 线程“main”java.lang的异常。R...
azkaban 与 java任务_azkaban任务报错java.lang.RuntimeException: The root scratch dir: /tmp/hive...
weixin_35867894的博客
02-23 245
azkaban运行任务的时候失败报错如下：23-03-2016 08:16:14 CST analyzer-kafka2hdfs_new ERROR - Exception in thread "main" org.apache.hive.service.cli.HiveSQLException: java.lang.RuntimeException: The root scratch dir: ...
kylin使用时候出现的问题及处理方式(二)
king_hui719的博客
09-05 2049
文章主要针对kylingence或者kylin及hadoop的各个组件使用的问题汇总： 问题7 Hive 重启后，Kyligence Enterprise 报错 "/tmp/hive-scratch on HDFS should be writable" 问题8问题描述： 在 FushionInsight C70 中重新启动 Hive 后，Kyligence Enterprise 报告 "...
The root scratch dir: /tmp/hive on HDFS should be writable.（已解决）
Han_Lin-的博客
12-15 462
The root scratch dir: /tmp/hive on HDFS should be writable.
The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwxr-xr-x
独立开发者 | 跨境电商
01-10 512
启动hive报的异常 使用hadoop fs -chmod -R 777 /tmp修改目录权限
Calling tool in ralgen.py: /hpc/simulation/jzhou/awakening_soc/infra/flow/dv/tools/ralgen/../../../../util/regtool.py -s -t /tmp/mct_dv_bb_env-ral_0.1cvwdpui1 /hpc/simulation/jzhou/awakening_soc/design/bb/dv/env/../../data/bb.hjson RAL pkg for bb written to /tmp/mct_dv_bb_env-ral_0.1cvwdpui1. INFO: Wrote dependency graph to /hpc/simulation/jzhou/awakening_soc/scratch/default/gnss_top-sim-vcs/default/sim-vcs/mct_dv_bb_sim_0.1.deps-after-generators.dot WARNING: The file ../../include/yuu_ahb_interface.svi in /hpc/simulation/jzhou/awakening_soc/infra/verif/uvc/yuu_ahb/src/sv/ahb_env.core is not within the directory containing the core file. This is deprecated and will be an error in a future FuseSoC version. A typical solution is to move core file into the root directory of the IP block it describes WARNING: The file ../../include/yuu_ahb_pkg.sv in /hpc/simulation/jzhou/awakening_soc/infra/verif/uvc/yuu_ahb/src/sv/ahb_env.core is not within the directory containing the core file. This is deprecated and will be an error in a future FuseSoC version. A typical solution is to move core file into the root directory of the IP block it describes. WARNING: The file ../../test/ahb_base_seq.sv in /hpc/simulation/jzhou/awakening_soc/infra/verif/uvc/yuu_ahb/src/sv/ahb_env.core is not within the directory containing the core file. This is deprecated and will be an error in a future FuseSoC version. A typical solution is to move core file into the root directory of the IP block it describes. ERROR: Setup failed : Cannot find ../../test/ahb_base_seq.sv in : /hpc/simulation/jzhou/awakening_soc/infra/verif/uvc/yuu_ahb/src/sv
07-20
根据提供的日志信息，错误发生在以下行： ``` ERROR: Setup failed : Cannot find ../../test/ahb_base_seq.sv in : /hpc/simulation/jzhou/awakening_soc/infra/verif/uvc/yuu_ahb/src/sv ``` 这个错误表示在指定的路径下找不到`../../test/ahb_base_seq.sv`文件。根据错误信息，该文件未被正确地放置在以下路径之一： - `/hpc/simulation/jzhou/awakening_soc/infra/verif/uvc/yuu_ahb/src/sv` 要解决这个问题，可以尝试以下几步： 1. 确保`../../test/ahb_base_seq.sv`文件存在于指定的路径中。检查文件的拼写和路径是否正确。 2. 确保路径中的文件和目录权限设置正确，确保文件可以被读取和访问。 3. 如果文件确实存在于指定路径中，但仍然报错，请检查其他可能的配置文件或设置，以确保它们正确指向该文件。 请根据你的具体情况检查和调整文件的位置和路径设置，以解决这个问题。如果你能提供更多的代码上下文或相关信息，我可以给出更具体的建议。
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值