Centos+sqoop1.4.6+hadoop

1.解压并配置环境变量

tar -zxvf sqoop-1.4.6.bin__hadoop-0.23.tar.gz 

vi /etc/profile

#set java environment
JAVA_HOME=/usr/local/jdk1.7.0_80
CLASSPATH=.:$JAVA_HOME/lib.tools.jar
PATH=$JAVA_HOME/bin:$PATH
export JAVA_HOME CLASSPATH PATH
HADOOP_HOME=/usr/local/hadoop
ZK_HOME=/usr/local/zookeeper-3.4.9
HIVE_HOME=/usr/local/hive/
SQOOP_HOME=cd /usr/local/sqoop
PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$ZK_HOME/bin:$HIVE_HOME/bin:$SQOOP_HOME/bin

source /etc/profile

2.修改配置文件

mv sqoop-env-template.sh sqoop-env.sh
mv sqoop-site-template.xml sqoop-site.xml

3.配置配置文件 ./sqoop-env.sh

vi ./sqoop/conf/sqoop-env.sh

HADOOP_COMMON_HOME=/usr/local/hadoop
HADOOP_MAPRED_HOME=/usr/local/hadoop
HIVE_HOME=/usr/local/hive
ZOOKEEPER_HOME=/usr/local/zookeeper-3.4.9
ZOOCFGDIR=/usr/local/zookeeper-3.4.9

4.将mysql驱动包cp到sqoop/lib

5.测试运行

 sqoop version

18/11/12 15:51:50 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
Sqoop 1.4.6
git commit id c0c5a81723759fa575844a0a1eae8f510fa32c25
Compiled by root on Mon Apr 27 14:20:17 CST 2015

6.连接数据库测试

[root@hadoop01 conf]# sqoop list-databases --connect jdbc:mysql://192.168.25.135:3306/ --username hive --password 123456

 用户名为初始化hive时的用户名

sqoop list-databases --connect jdbc:mysql://192.168.25.135:3306/ --username hive --password 123456


18/11/12 16:12:46 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
18/11/12 16:12:46 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
18/11/12 16:12:46 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
information_schema
mysql
onhive
test