【sqoop2】sqoop-1.99.7安装

sqoop2安装

下载和解压
http://ftp.wayne.edu/apache/sqoop/
# tar -zxvf sqoop-1.99.7-bin-hadoop200.tar.gz -C /opt
# mv /opt/sqoop-1.99.7-bin-hadoop200 /opt/sqoop

$ vi conf/sqoop.properties
添加
# 设置日志文件的目录
0,%s/@LOGDIR@/\/opt\/sqoop\/logs/g
# 设置数据的存放目录
0,%s/@BASEDIR@/\/opt\/sqoop\/bin\/BASEDIR/g

org.apache.sqoop.security.authentication.type=SIMPLE
org.apache.sqoop.security.authentication.handler=org.apache.sqoop.security.authentication.SimpleAuthenticationHandler
org.apache.sqoop.security.authentication.anonymous=true

修改
org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/opt/hadoop3/etc/hadoop

注：
”\“为转义

在hadoop环境下的$HADOOP_HOME/etc/hadoop/core-site.xml添加
    <property>
        <name>hadoop.proxyuser.sqoop2.hosts</name>
        <value>*</value>
    </property>
    <property>
        <name>hadoop.proxyuser.sqoop2.groups</name>
        <value>*</value>
    </property>
    
添加 mysql 的驱动
$ cp /home/hadoop/tmp/mysql-connector-java-5.1.46-bin.jar /opt/sqoop/server/lib/

删除lib里derby-10.8.2.2.jar包，因这个包太旧了，从hive的lib拷贝一个derby-10.14.1.0.jar版本的过来

#验证
sqoop2-tool upgrade
sqoop2-tool verify

启动
sqoop2-server start

查看进程
jps