Hadoop数据传输工具sqoop(四)Java远程调用Sqoop进行数据传输

18 篇文章 0 订阅
4 篇文章 0 订阅

1、Maven配置

<dependency>
    <groupId>org.apache.sqoop</groupId>
    <artifactId>sqoop</artifactId>
    <version>1.4.5</version>
</dependency>

2、Java代码

@Service
public class SqoopTestServiceImpl implements SqoopTestService
{
  //测试代码
  public static void main(String[] args)
  {
    try {
        new WordCountServiceImpl().importDataFromOracle();
    } catch (Exception e){
       e.printStackTrace();
    }
  }

  @Override
  public int importDataFromOracle() {
	String[] args = new String[]{
		"--connect", "jdbc:oracle:thin:@192.168.10.12:1521:ftmsdev",
		"--username", "ftms",
		"--password", "ftms",
		"--table", "SYSTEM_USER",
		"--columns", "LOGIN_NAME,PASSWORD",
		"--split-by", "USER_ID",
		"--target-dir", "ftms/tables/system_user"
	};

	String[] expandedArgs = null;
	try {
        expandedArgs = OptionsFileUtil.expandArguments(args);
    } catch (Exception e){
       System.err.println(ex.getMessage());
	   System.err.println("Try 'sqoop help' for usage.");
    }

	com.cloudera.sqoop.tool.SqoopTool tool = (com.cloudera.sqoop.tool.SqoopTool) SqoopTool.getTool("import");
	//com.cloudera.sqoop.tool.SqoopTool tool = new ImportTool();

    Configuration conf = new Configuration();
    conf.set("fs.default.name", "hdfs://192.168.242.128:9000");//设置hadoop服务地址
	Configuration pluginConf = SqoolTool.loadPlugins(conf);

	Sqoop sqoop = new Sqoop(tool, pluginConf);
	return Sqoop.runSqoop(sqoop, expandedArgs);
  }

}


3、查看导入结果

$ hadoop dfs -ls ftms/tables
…… /user/guzicheng/ftms/tables/system_user



参考:

http://iyanlei.com/java_sqoop.html

http://blog.csdn.net/wuzhongju/article/details/8938159

《Sqoop Developer’s Guide v1.4.5》

《Sqoop User Guide (v1.4.1-incubating)》

评论 5
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值