部署的前提是已经存在HADOOP、HBASE、HIVE、ZOOKEEPER环境
(1)下载地址:sqoop-1.4.6
解压到/home/sqoop/sqoop1.4
(2)、配置环境变量在:/etc/profiles 文件中添加下面内容
#sqoop
export SQOOP_HOME=/home/sqoop/sqoop1.4
export PATH=$PATH:$SQOOP_HOME/bin
(3)、修改sqoop配置文件
复制sqoop1.4/conf/sqoop-env-template.sh为sqoop-env.sh
命令: cp $SQOOP_HOME/conf/sqoop-env-template.sh $SQOOP_HOME/conf/sqoop-env.sh
添加相关的配置 (只需把sqoop-env.sh中#号去掉然后把=右边填上对应的路径就行了,分别是HADOOP,HBASE,HIVE,ZOOKEEPER的主目录)
#Setpath to where bin/hadoop is available
export HADOOP_COMMON_HOME=/home/hadoop/hadoop
#Setpath to where hadoop-*-core.jar isavailable
expor tHADOOP_MAPRED_HOME=/home/hadoop/hadoop
#setthe path to where bin/hbase isavailable
export HBASE_HOME=/home/hbase/hbase
#Setthe path to where bin/hive is available
export HIVE_HOME= /home/hive/hive
#Setthe path for where zookeper config diris
export ZOOCFGDIR= /home/zookeeper/zookeeper
(4)、测试Sqoop
发现有警告
修改$SQOOP_HOME/bin/configure-sqoop
注释掉HCatalog,Accumulo检查(除非你准备使用HCatalog,Accumulo等HADOOP上的组件)
## Moved to be a runtime check in sqoop.
#if [ ! -d "${HCAT_HOME}" ]; then
# echo "Warning: $HCAT_HOME does not exist! HCatalog jobs willfail."
# echo 'Please set $HCAT_HOME to the root of your HCatalog installation.'
#fi
#if [ ! -d "${ACCUMULO_HOME}" ];then
# echo "Warning: $ACCUMULO_HOME does not exist! Accumulo imports willfail."
# echo 'Please set $ACCUMULO_HOME to the root of your Accumuloinstallation.'
#fi
再次执行sqoop version
18/03/31 09:13:28 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.5.2
Sqoop 1.4.6-cdh5.5.2
查看某一个命令的使用说明:
$ sqoopimport --help
$ sqoophelp import