Sqoop 安装与部署
更多Hadoop组件配套安装与部署
Hadoop:https://blog.csdn.net/Gordo_Li/article/details/103309484
Hbase: https://blog.csdn.net/Gordo_Li/article/details/103199302
Hive: https://blog.csdn.net/Gordo_Li/article/details/103199319
Pig: https://blog.csdn.net/Gordo_Li/article/details/103199334
Sqoop: https://blog.csdn.net/Gordo_Li/article/details/103199352
Flume: https://blog.csdn.net/Gordo_Li/article/details/103199291
Zoopkeeper: https://blog.csdn.net/Gordo_Li/article/details/103199364
部分组件软件包:
soft.gz.tar: https://download.csdn.net/download/Gordo_Li/11993074
-
下载软件,解压与移动
cd /data/soft/ tar -zxvf sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz mv sqoop-1.4.7.bin__hadoop-2.6.0 /data/sqoop-1.4.7 cd /data ll
-
设置变量环境
vi /etc/profile export JAVA_HOME=/usr/local/jdk1.8 export HADOOP_HOME=/data/hadoop-2.7.3 export HIVE_HOME=/data/hive-2.3.6 export HBASE_HOME=/data/hbase-1.2.6 export PIG_HOME=/data/pig-0.17.0 export SQOOP_HOME=/data/sqoop-1.4.7 export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HIVE_HOME/bin:$HBASE_HOME/bin:$PIG_HOME/bin:$SQOOP_HOME/bin source /etc/profile
-
配置Sqoop
- 获取MySQL连接器
Sqoop经常与MySQL结合,从Hadoop数据源向MySQL数据库导入数据,或从Hadoop各组件导入数据到MySQL。所以为其配置Java连接器(Mysql的Jave连接器也成为JDBC驱动程序)可在MySQL官网(http://central.maven.org/maven2/mysql/mysql-connector-java/)找到,下载并解压
- 获取MySQL连接器