1.sqoop版本
sqoop1 | sqoop2 |
---|---|
sqoop1.4.7 | sqoop1.99.x |
sqoop1不支持hbase2.x
sqoop2支持hbase2.x,hadoop1,hadoop2及更高版本
2.解压(sqoop1)
sudo chmod 777 sqoop-4.7-bin-hadoop200.tar.gz
sudo tar -zxvf sqoop-14.7-bin-hadoop200.tar.gz -C /home/hdfs/software
sudo mv sqoop-1.4.7-bin-hadoop200 sqoop-1.4.7
sudo ln -s sqoop-1.4.7 sqoop
3.修改环境变量
sudo vi /etc/profile
export SQOOP_HOME=/home/hdfs/software/sqoop
export PATH=
P
A
T
H
:
PATH:
PATH:SQOOP_HOME/bin
source /etc/profile
4.修改sqoop-env.sh
sudo cp sqoop-env-template.sh sqoop-env.sh
sudo vi sqoop-env.sh
export HADOOP_COMMON_HOME=/opt/hadoop
export HADOOP_MAPRED_HOME=/opt/hadoop
export HBASE_HOME=/home/hdfs/software/hbase
export HIVE_HOME=/home/hdfs/software/hive
export ZOOCFGDIR=/home/hdfs/software/zookeeper/conf
5.拷贝jdbc的驱动包到lib目录下
sudo cp /home/hdfs/mysql-connector-java-5.1.49.jar /home/hdfs/software/sqoop/lib
6.连接mysql验证
service mysql start
bin/sqoop list-databases --connect jdbc:mysql://192.168.157.134:3306 --username root --password root
bin/sqoop list-tables --connect jdbc:mysql://192.168.157.134:3306/mysql --username root --password root