sqoop的安装部署

1 下载

1. 下载地址
2. 作者使用的是sqoop-1.4.6-cdh5.7.0.tar.gz版本

2 上传到linux上，并解压

[hadoop@zhangyu software]$ tar -xzvf sqoop-1.4.6-cdh5.7.0.tar.gz
修改用户和用户组
[hadoop@zhangyu software]$ sudo chown hadoop:hadoop sqoop-1.4.6-cdh5.7.0
sudo chown hadoop:hadoop sqoop/*
改成sqoop
[hadoop@zhangyu software]$ sudo mv sqoop-1.4.6-cdh5.7.0 sqoop

3 拷贝mysql的jdbc驱动包mysql-connector-java-5.1.45-bin.jar到sqoop/lib目录下

（这里我直接拷贝的hive下面已经下载好的驱动）
[hadoop@zhangyu lib]$ sudo cp /opt/software/hive/lib/mysql-connector-java-5.1.45-bin.jar .

4 配置环境变量

[hadoop@zhangyu sqoop]$ sudo vi /etc/profile
添加自己的配置
export SQOOP_HOME=/opt/software/sqoop 
export PATH=$PATH:$SQOOP_HOME/bin

5 复制sqoop/conf/sqoop-env-template.sh为sqoop-env.sh，添加配置

[hadoop@zhangyu conf]$ cp sqoop-env-template.sh sqoop-env.sh

#Setpath to where bin/hadoop is available
exportHADOOP_COMMON_HOME=/opt/software/hadoop
#Setpath to where hadoop-*-core.jar isavailable
exportHADOOP_MAPRED_HOME=/opt/software/hadoop
#setthe path to where bin/hbase isavailable
#exportHBASE_HOME=/opt/software/hbase 
#Setthe path to where bin/hive is available
exportHIVE_HOME= /opt/software/hive
#Setthe path for where zookeper config diris
#exportZOOCFGDIR= /opt/software/zookeeper

6 测试

[hadoop@zhangyu conf]$ sqoop version
Warning: /opt/software/sqoop/../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: /opt/software/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /opt/software/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
Warning: /opt/software/sqoop/../zookeeper does not exist! Accumulo imports will fail.
Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
18/01/14 12:47:03 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.7.0
Sqoop 1.4.6-cdh5.7.0
git commit id 
Compiled by jenkins on Wed Mar 23 11:30:51 PDT 2016

[hadoop@zhangyu conf]$ sqoop import --help

这里的警告是因为我没有配置hbase，zookeeper，HCatalog