eclipse写文件入hdfs失败
在hadoop平台下基于eclipse运行oryx程序时,报如下错:
java.lang.RuntimeException: Cannot create job output directory /tmp/crunch-1820027447
at org.apache.crunch.impl.dist.DistributedPipeline.createTempDirectory(DistributedPipeline.java:318)
at org.apache.crunch.impl.dist.DistributedPipeline.<init>(DistributedPipeline.java:93)
at org.apache.crunch.impl.mr.MRPipeline.<init>(MRPipeline.java:97)
at com.cloudera.oryx.computation.common.JobStep.createBasicPipeline(JobStep.java:330)
at com.cloudera.oryx.als.computation.merge.MergeIDMappingStep.createPipeline(MergeIDMappingStep.java:50)
at com.cloudera.oryx.computation.common.JobStep.run(JobStep.java:187)
意为无法写入。推测错误有可能时内存不足或者权限问题。排除内存不足的原因后