sqoop安装

sqoop安装与环境配置

1. 确保JDK的正确安装与环境配置

2. 确保Mysql的正确安装与环境配置

3. 确保Hadoop的正确安装与正常启动

4. sqoop安装

   1. 安装包的解压与重命名

      tar -zxvf /opt/download/sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz -C /opt/software/
      mv sqoop-1.4.6.bin__hadoop-2.0.4-alpha/ sqoop146
      

   2. 导mysql驱动包mysql-connector-java-5.1.47到sqoop146的lib文件夹下

   • 到IDEA本地仓库去找到mysql驱动包拖到lib文件夹下

   3. 导hadoop驱动包到sqoop的lib文件夹

      cd /opt/software/sqoop146/lib/
      
      cp /opt/software/hadoop2101/share/hadoop/common/hadoop-common-2.10.1.jar ./
      cp /opt/software/hadoop2101/share/hadoop/hdfs/hadoop-hdfs-2.10.1.jar ./
      cp /opt/software/hadoop2101/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.10.1.jar ./
      

   4. 到sqoop的conf文件下更改配置

      cd /opt/software/sqoop146/conf/
      
      cp  sqoop-env-template.sh sqoop-env.sh
      
      vim sqoop-env.sh
      #修改文件中Hadoop的地址
      export HADOOP_COMMON_HOME=/opt/software/hadoop2101
      export HADOOP_MAPRED_HOME=/opt/software/hadoop2101
      export HIVE_HOME=/opt/software/hive238
      #如果装了HBase和zookeeper，还要配置以下
      export HBASE_HOME=/opt/software/hadoop/hbase235
      export ZOOCFGDIR=/opt/software/hadoop/zookeeper357
      

   5. 环境配置

      #编辑环境变量配置文件
      vim /etc/profile.d/myenv.sh
      
      #sqoop
      export SQOOP_HOME=/opt/software/sqoop146
      export PATH=$SQOOP_HOME/bin:$PATH
      export LOGDIR=$SQOOP_HOME/logs/
      
      #刷新环境变量
      
      source /etc/profile
      
      
      

5. 测试安装

   1. 查看版本号

      sqoop version
      
      #执行结果：
      21/07/01 19:19:41 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
      Sqoop 1.4.6
      

   2. 检测与MySQL连接

      sqoop list-databases --connect jdbc:mysql://localhost:3306 --username root --password 123456
      #密码是MySQL密码
      

      

6
#密码是MySQL密码
```

  [外链图片转存中...(img-YWn5SC8q-1625139294095)]

  如果可以查到数据库，那就是安装成功了。