sqoop安装及配置

本文主要介绍sqoop安装及配置。
版本：1.4.6

sqoop安装

1.将sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz解压到安装目录。

unzip  sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz -d /home/hadoopadmin/

2.将sqoop加入环境变量

打开环境变量文件：

vim /etc/profile

追加下列内容：

export SQOOP_HOME=/home/hadoopadmin/sqoop-1.4.6.bin__hadoop-2.0.4-alpha
export PATH=$PATH:$SQOOP_HOME/bin

重新编译环境变量：

source /etc/profile

3.给${SQOOP_HOME}/bin中文件赋予可执行权限

chmod 744 *

sqoop配置

1.sqoop-env.sh配置

配置文件目录：$SQOOP_HOME/conf,sh(重命名sqoopenvtemplate.
sh)

#Set path to where bin/hadoop is available
export HADOOP_COMMON_HOME=/home/hadoopadmin/hadoop-2.7.1
#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/home/hadoopadmin/hadoop-2.7.1
#set the path to where bin/hbase is available
#export HBASE_HOME=
#Set the path to where bin/hive is available
export HIVE_HOME=/home/hadoopadmin/apache-hive-1.2.1-bin

2.修改$SQOOP_HOME/bin/sqoop

vim sqoop

修改最后一行内容
修改前：

exec ${HADOOP_COMMON_HOME}/bin/hadoop  org.apache.sqoop.Sqoop "$@"

修改后：

exec ${HADOOP_COMMON_HOME}/bin/hadoop jar $SQOOP_HOME/sqoop-1.4.6.jar  org.apache.sqoop.Sqoop "$@"

3.将mysql驱动jar拷贝至$SQOOP_HOME/lib目录

4. 将hadoop-common-2.7.1.jar拷贝至$SQOOP_HOME/lib目录

cp ${HADOOP_HOME}/share/hadoop/common/hadoop-common-2.7.1.jar ${SQOOP_HOME}/lib

5. 测试命令

打印出mysql数据库中的所有DB

sqoop list-databases --connect jdbc:mysql://127.0.0.1:3306/ --username
root --password root

相关文章

通过sqoop进行mysql与hive的导入导出