sqoop1.4.7兼容hadoop2.6以上所有版本
1 下载并解压
1)下载地址:http://mirrors.hust.edu.cn/apache/sqoop
2)上传安装包sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz到服务器
3)解压sqoop安装包
tar -zxf sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz
4)添加环境变量
2 修改配置文件
1) 进入到/opt/module/sqoop/conf目录,重命名配置文件
mv sqoop-env-template.sh sqoop-env.sh
2) 修改配置文件
vi sqoop-env.sh
增加如下内容
export HADOOP_COMMON_HOME=/root/software/hadoop-3.2.1
export HADOOP_MAPRED_HOME=/root/software/hadoop-3.2.1
3 拷贝JDBC驱动
下载jar包可以去https://mvnrepository.com/maven仓库进行下载
1)将mysql-connector-java-8.0.16.jar拷贝jdbc驱动到sqoop的lib目录下
4.修改配置文件
在bin目录下修改configure-sqoop,修改掉对hbase和ZOOKEEPER的验证
## Moved to be a runtime check in sqoop.
#if [ ! -d "${HBASE_HOME}" ]; then
# echo "Warning: $HBASE_HOME does not exist! HBase imports will fail."
# echo 'Please set $HBASE_HOME to the root of your HBase installation.'
#fi
#if [ ! -d "${ZOOKEEPER_HOME}" ]; then
# echo "Warning: $ZOOKEEPER_HOME does not exist! Accumulo imports will fail."
# echo 'Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.'
#fi
5.可能会报错,说是Stringutils没找到
下载并导入commons-lang-2.6.jar包即可
6.测试运行
bin/sqoop list-tables --connect jdbc:mysql://10.9.1.139:3306/cluster?serverTimezone=UTC --username root --password a