Sqoop
Sqoop的使用
微电子学与固体电子学-俞驰
如切如磋,如琢如磨,臻于至善。
展开
-
安装sqoop以后,hive中的info信息无法禁止的问题解决
配置完sqoop以后,我们会发现,即使使用下列文件也无法禁止INFO级别的信息出现/home/appleyuchi/bigdata/hadoop-3.0.3/etc/hadoop/log4j.properties解决方案:下面的信息,在启动sqoop的时候再激活,平时没啥用的时候注释掉即可# export HADOOP_COMMON_HOME=$HADOOP_HOME/share/...原创 2018-07-28 20:03:44 · 1036 阅读 · 0 评论 -
sqoop种出现:There are issues with entered data, please revise your input问题解决
sqoop:000> create link --cid 1 Creating link for connector with id 1Please fill following values to create new link objectName: mysqlLink configurationJDBC Driver Class: ge...原创 2018-07-29 15:30:42 · 824 阅读 · 0 评论 -
sqoop2出现Connection refused
Sqoop home directory: /home/appleyuchi/bigdata/sqoop-1.99.5-bin-hadoop200Setting SQOOP_HTTP_PORT: 12000Setting SQOOP_ADMIN_PORT: 12001Using CATALINA_OPTS: Adding to CATALINA_OPTS: ...原创 2018-07-29 18:40:56 · 858 阅读 · 0 评论 -
sqoop2操作流程
--------------------------配置-------------------------------------配置/home/appleyuchi/bigdata/sqoop-1.99.5-bin-hadoop200/server/conf中的sqoop.properties文件以及catalina.properties文件catalina.properties中修改如...原创 2018-07-30 10:11:52 · 931 阅读 · 0 评论 -
sqoop把mysql数据导入hbase-完整记录
环境:sqoop1.4.7mysql8.0hbase2.2.4hadoop3.1.2##############################################################################mysql> create database sqoop_hbase;mysql> use sqoop_hbase;mysql> CREATE TABLE book( -> id INT(4) PRIMAR...原创 2020-05-25 23:36:27 · 2074 阅读 · 10 评论 -
sqoop出现Error parsing arguments for import
2020-05-27 11:08:54,840 ERROR tool.BaseSqoopTool: Error parsing arguments for import:2020-05-27 11:08:54,840 ERROR tool.BaseSqoopTool: Unrecognized argument: appleyuchi--table2020-05-27 11:08:54,841 ERROR tool.BaseSqoopTool: Unrecognized argument: bo...原创 2020-05-27 11:15:31 · 12039 阅读 · 1 评论 -
sqoop把mysql数据导入hive
环境:软件 版本 备注 Ubuntu 19.10 sqoop 1.4.7 mysql 8.0.20-0ubuntu0.19.10.1 (Ubuntu) hadoop 3.1.2 hive 3.0.0 之所以和hive有关系是因为需要在.bashrc中设置HCAT_HOME accumulo 2.0.0 需要配合sqoop在.bashrc中设置ACCUMULO_HOMT 数...原创 2020-05-27 11:56:24 · 682 阅读 · 0 评论