sqoop 安装配置记录:
1、下载:
(1)wget准备:
yum -y install wget
(2)sqoop准备(选一):
wget https://mirror.bit.edu.cn/apache/sqoop/1.4.7/sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz
wget https://mirrors.bfsu.edu.cn/apache/sqoop/1.4.7/sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz
wget https://mirrors.tuna.tsinghua.edu.cn/apache/sqoop/1.4.7/sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz
2、解压
tar -zxvf sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz
3、重命名
mv sqoop-1.4.7.bin__hadoop-2.6.0 sqoop
4、配置sqoop——MySQL连接器:
下载对应的MySQL连接jar
https://dev.mysql.com/downloads/connector/j/
只是要解压出来的mysql-connector-java-5.1.49.jar文件并将其拷贝至sqoop安装目录下的lib文件夹里
5、配置sqoop环境变量:
vi ~/.bash_profile
(1)添加:
#SQOOP
export SQOOP_HOME=/opt/sqoop
export PATH=$SQOOP_HOME/bin:$PATH
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:$HIVE_HOME/lib/*
(2)配置生效:
source ~/.bash_profile
6、修改配置文件:
cd /opt/sqoop/conf
(1)复制一份配置文件并重命名
cp sqoop-env-template.sh sqoop-env.sh
(2)编辑sqoop-env.sh 修改路径
vi sqoop-env.sh
(3)编辑文件configure-sqoop注释代码(根据实际情况注释,不用的可以注释掉,否则会输出很多提示信息)
bin目录下:
cd /opt/sqoop/bin
vi configure-sqoop
7、查看版本验证安装
sqoop version
复制目录到各个主机:
scp -r /opt/sqoop slave0:/opt
8、测试连接mysql,查看数据库
sqoop list-databases --connect jdbc:mysql://192.168.56.20:3306/ --username root --password 123456
sqoop list-tables --connect jdbc:mysql://192.168.56.20:3306/hive --username root --password 123456