sqoop1.4.6安装部署

安装部署环境

Hadoop 2.7.3

jdk1.8

mysql 5.6

sqoop-1.4.6-cdh5.7.5.tar

sqoop安装

1.解压 sqoop-1.4.6-cdh5.7.5.tar 至/opt/behApache/core 重命名为sqoop

2.拷贝mysql的jdbc驱动包 mysql-connector-java-5.1.30.jar 到sqoop/lib目录下

3.配置环境变量

export SQOOP_HOME=/opt/behApache/core/sqoop
export PATH=$PATH:$SQOOP_HOME/bin

4.复制sqoop/conf/sqoop-env-template.sh为sqoop-env.sh

添加相关配置：

#Set path to where bin/hadoop is available
export HADOOP_COMMON_HOME=/opt/behApache/core/hadoop

#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/opt/behApache/core/hadoop

#set the path to where bin/hbase is available
export HBASE_HOME=/opt/behApache/core/hbase

#Set the path to where bin/hive is available
export HIVE_HOME=/opt/behApache/core/hive

#Set the path for where zookeper config dir is
export ZOOCFGDIR=/opt/behApache/core/zookeeper

测试

sqoop import --connect jdbc:mysql://test104:3306/sqoop --username root --password 123456 --table test01

报错：

Exception in thread "main" java.lang.NoClassDefFoundError: org/json/JSONObject

解决：

下载json.jar包放到sqoop/lib下

重新执行，查看hdfs，导入成功。