学习笔记:从0开始学习大数据-40.sqoop1的安装

最新推荐文章于 2022-04-07 14:26:00 发布

领尚

最新推荐文章于 2022-04-07 14:26:00 发布

阅读量336

点赞数

分类专栏： Hadoop 系统集成文章标签： sqoop

本文链接：https://blog.csdn.net/oLinBSoft/article/details/104625782

版权

系统集成同时被 2 个专栏收录

149 篇文章 6 订阅

订阅专栏

Hadoop

46 篇文章 7 订阅

订阅专栏

前面安装的是sqoop2（sqoop1.99.5），可以正常使用，但还是问题多多，因下一节的综合实训要用到sqoop1，就同时安装了一个。

其实，sqoop1的安装特别简单

yum install sqoop

=======================================================================================
Package 架构版本源大小
=======================================================================================
正在安装:
sqoop noarch 1.4.6+cdh5.15.1+136-1.cdh5.15.1.p0.4.el7 impala 18 M
为依赖而安装:
kite noarch 1.0.0+cdh5.15.1+147-1.cdh5.15.1.p0.4.el7 impala 104 M

事务概要
=======================================================================================
安装 1 软件包 (+1 依赖软件包)

总下载量：122 M
安装大小：161 M
Is this ok [y/d/N]: y

2. 第一次运行，出现

[root@centos7 ~]# sqoop
Warning: /usr/lib/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /usr/lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
Try 'sqoop help' for usage.

解决

nano /lib/sqoop/bin/configure-sqoop

注释掉$HCAT_HOME 和 $ACCUMULO_HOME 两节

#if [ -z "${HCAT_HOME}" ]; then
#  if [ -d "/usr/lib/hive-hcatalog" ]; then
#    HCAT_HOME=/usr/lib/hive-hcatalog
#  elif [ -d "/usr/lib/hcatalog" ]; then
#    HCAT_HOME=/usr/lib/hcatalog
#  else
#    HCAT_HOME=${SQOOP_HOME}/../hive-hcatalog
#    if [ ! -d ${HCAT_HOME} ]; then
#       HCAT_HOME=${SQOOP_HOME}/../hcatalog
#    fi
#  fi
#fi

#if [ -z "${ACCUMULO_HOME}" ]; then
#  if [ -d "/usr/lib/accumulo" ]; then
#    ACCUMULO_HOME=/usr/lib/accumulo
#  else
#    ACCUMULO_HOME=${SQOOP_HOME}/../accumulo
#  fi
#fi
## Moved to be a runtime check in sqoop.
#if [ ! -d "${HCAT_HOME}" ]; then
#  echo "Warning: $HCAT_HOME does not exist! HCatalog jobs will fail."
#  echo 'Please set $HCAT_HOME to the root of your HCatalog installation.'
#fi

#if [ ! -d "${ACCUMULO_HOME}" ]; then
#  echo "Warning: $ACCUMULO_HOME does not exist! Accumulo imports will fail."
#  echo 'Please set $ACCUMULO_HOME to the root of your Accumulo installation.'
#fi

3.运行出现不能加com.mysql.jdbc.Driver

20/03/03 09:21:15 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: com.mysql.jdbc.Driver

复制jar包 mysql-connector-java-8.0.13.jar 到/lib/sqoop/lib 目录

4. 出现错误

Caused by: java.lang.ClassNotFoundException: org.json.JSONObject
解决：到下面网站

http://www.java2s.com/Code/Jar/j/Downloadjavajsonjar.htm

下载 java-json.jar.zip 解压出java-json.jar 复制到 /lib/sqoop/lib 目录

sqoop1即可正常使用