Hadoop Sqoop 集群保姆式搭建

12. Sqoop 安装配置

12.1 解压 Sqoop 到指定目录

tar -zxvf /chinaskills/sqoop-1.4.2.bin__hadoop-2.0.0-alpha.tar.gz -C /opt/

12.2 配置 Sqoop 环境变量

vi /root/.bash_profile

export JAVA_HOME=/usr/local/src/jdk1.8.0_162
export HADOOP_HOME=/usr/local/src/hadoop-2.7.7
export ZOOKEEPER_HOME=/usr/local/src/zookeeper
export FLUME_HOME=/opt/apache-flume-1.7.0-bin
export HIVE_HOME=/opt/apache-hive-2.3.4-bin
export KAFKA_HOME=/opt/kafka_2.11-2.0.0
export SQOOP_HOME=/opt/sqoop-1.4.2.bin__hadoop-2.0.0-alpha
PATH=$PATH:$HOME/bin:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$ZOOKEEPER_HOME/bin:$FLUME_HOME/bin:$HIVE_HOME/bin:$KAFKA_HOME/bin:$SQOOP_HOME/bin
export PATH

source /root/.bash_profile

12.3 配置 Sqoop config 文件

cd /opt/sqoop-1.4.2.bin__hadoop-2.0.0-alpha/conf/
cp sqoop-env-template.sh sqoop-env.sh
vi sqoop-env.sh

# Set Hadoop-specific environment variables here.

#Set path to where bin/hadoop is available
export HADOOP_HOME=/usr/local/src/hadoop-2.7.7	（自己的 Hadoop 路径）

#set the path to where bin/hbase is available
#export HBASE_HOME=

#Set the path to where bin/hive is available
export HIVE_HOME=/opt/apache-hive-2.3.4-bin		（自己的 Hive 路径）

#Set the path for where zookeper config dir is
export ZOOCFGDIR=/usr/local/src/zookeeper		（自己的 Zookeeper 路径）
                                           

12.4 启动 Sqoop

将 MySQL 的驱动放到 Sqoop 的 lib 包下
cp /chinaskills/mysql-connector-java-5.1.38.jar /opt/sqoop-1.4.2.bin__hadoop-2.0.0-alpha/lib/

测试连接 master 的 MySQL 数据库

sqoop-list-databases --connect jdbc:mysql://master:3306 --username root --password 123456

成功连接！