sqoop错误

String url = "http://localhost:12000/sqoop/";
SqoopClient client = new SqoopClient(url);
//Creating dummy job object
MJob job = client.createJob("fromLinkName", "toLinkName");
job.setName("Vampire");
job.setCreationUser("Buffy");
// set the "FROM" link job config values
MFromConfig fromJobConfig = job.getFromJobConfig();
fromJobConfig.getStringInput("fromJobConfig.schemaName").setValue("sqoop");
fromJobConfig.getStringInput("fromJobConfig.tableName").setValue("sqoop");
fromJobConfig.getStringInput("fromJobConfig.partitionColumn").setValue("id");
// set the "TO" link job config values
MToConfig toJobConfig = job.getToJobConfig();
toJobConfig.getStringInput("toJobConfig.outputDirectory").setValue("/usr/tmp");
// set the driver config values
MDriverConfig driverConfig = job.getDriverConfig();
driverConfig.getIntegerInput("throttlingConfig.numExtractors").setValue(3);

以上是官方文档中的job创建的代码,但运行是会抛出以下错误

Error: org.apache.sqoop.common.SqoopException:MAPRED_EXEC_0018:Error occurs during loader run at
org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$Cons
umerThread.run(SqoopOutputFormatLoadExecutor.java:292) at
 java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at
 java.util.concurrent.FutureTask.run(FutureTask.java:266) at
 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at
 java.util.concurrent.ThreadPoolExecutor$Worker.run(Thread
 PoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: 
 org.apache.sqoop.common.SqoopException: CORE_0000:An 
 unknown error has occurred at 
 org.apache.sqoop.utils.ClassUtils.executeWithClassLoader(
 ClassUtils.java:286) at 
 org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$Con
 sumerThread.run(SqoopOutputFormatLoadExecutor.java:259) 
 ... 5 more Caused by: java.lang.NullPointerException at 
 org.apache.sqoop.connector.hdfs.HdfsLoader.getExtension(H
 dfsLoader.java:161) at 
 org.apache.sqoop.connector.hdfs.HdfsLoader.access$100(Hdf
 sLoader.java:45) at 
 org.apache.sqoop.connector.hdfs.HdfsLoader$1.run(HdfsLoad
 er.java:86) at 
 org.apache.sqoop.connector.hdfs.HdfsLoader$1.run(HdfsLoad
 er.java:60) at 
 java.security.AccessController.doPrivileged(Native 
 Method) at 
 javax.security.auth.Subject.doAs(Subject.java:422) at
 org.apache.hadoop.security.UserGroupInformation.doAs(User
 GroupInformation.java:1698) at 
 org.apache.sqoop.connector.hdfs.HdfsLoader.load(HdfsLoade
 r.java:60) at 
 org.apache.sqoop.connector.hdfs.HdfsLoader.load(HdfsLoade
 r.java:45) at 
 org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$Con
 sumerThread$1.call(SqoopOutputFormatLoadExecutor.java:279) at 
 org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$Con
 sumerThread$1.call(SqoopOutputFormatLoadExecutor.java:260
 ) at 
 org.apache.sqoop.utils.ClassUtils.executeWithClassLoader(
 ClassUtils.java:281) ... 6 more

原因是没有指定结果输出类型
应在
// set the “TO” link job config values下指定输出格式

toJobConfig.getInput("toJobConfig.outputFormat").setValue("TEXT_FILE");
  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值