sqoop-1.99.6安装和测试

最新推荐文章于 2021-02-22 02:58:38 发布

zhexcel

最新推荐文章于 2021-02-22 02:58:38 发布

阅读量640

点赞数 1

分类专栏：平台搭建文章标签：平台搭建

本文链接：https://blog.csdn.net/zhexcel/article/details/52192770

版权

本文详细介绍了在hadoop-2.7.2和apache-hive-1.2.1环境下安装sqoop-1.99.6的步骤，包括解压、配置环境变量、创建logs文件夹、导入jar包，并修改配置文件。接着，文章通过启动服务、验证安装、创建并管理connector和job等操作，全面展示了Sqoop的测试过程，帮助读者理解如何使用和管理Sqoop连接器和作业。

摘要由CSDN通过智能技术生成

一、实验环境
hadoop-2.7.2
apache-hive-1.2.1-bin
sqoop-1.99.6-bin-hadoop200
二、安装Sqoop
1、解压
在/opt/文件夹下执行命令

tar -zxvf sqoop-1.99.6-bin-hadoop200.tar.gz

2、在/etc/profile中添加引用
进入profile文件

vim /etc/profile

export SQOOP2_HOME=/opt/sqoop-1.99.6-bin-hadoop200
export CATALINA_BASE=$SQOOP2_HOME/server
export PATH=.:$SQOOP2_HOME/bin:$PATH

source /etc/profile

3、创建logs文件夹
切换到/opt/目录下，创建文件夹

mkdir logs
cd logs
查看文件夹路径
pwd 
/opt/sqoop-1.99.6-bin-hadoop200/logs

4、将mysql-connector-java-5.1.25-bin.jar导入到/opt/sqoop-1.99.6-bin-hadoop200/server/lib下面
5、修改server/conf下面文件
（1）sqoop.properties
将@LOGDIR@替换为之前的文件夹logs路径：/opt/sqoop-1.99.6-bin-hadoop200/logs
将derby的路径，@BASEDIR@修改为：/opt/sqoop-1.99.6-bin-hadoop200
将Hadoop的conf文件路径修改

org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/opt/hadoop-2.7.2/etc/hadoop

（2）catalina.properties
引入相关包，将原来的common.loader注释

common.loader=${
   catalina.base}/lib,${
   catalina.base}/lib/*.jar,${
   catalina.home}/lib,${
   catalina.home}/lib/*.jar,${
   catalina.home}/../lib/*.jar,/opt/hadoop-2.7.2/share/hadoop/common/*.jar,/opt/hadoop-2.7.2/share/hadoop/common/lib/*.jar,/opt/hadoop-2.7.2/share/hadoop/hdfs/*.jar,/opt/hadoop-2.7.2/share/hadoop/hdfs/lib/*.jar,/opt/hadoop-2.7.2/share/hadoop/mapreduce/*.jar,/opt/hadoop-2.7.2/share/hadoop/mapreduce/lib/*.jar,/opt/hadoop-2.7.2/share/hadoop/tools/*.jar,/opt/hadoop-2.7.2/share/hadoop/tools/li