sqoop
钻石大门
程序员
展开
-
sqoop部署
部署安装解压并做软链接[hadoop@10-9-15-140 soft]$ pwd/home/hadoop/soft[hadoop@10-9-15-140 soft]$ wget http://archive.cloudera.com/cdh5/cdh/5/sqoop-1.4.6-cdh5.7.0.tar.gz[hadoop@10-9-15-140 soft]$ tar -zxvf sq...原创 2019-07-30 09:28:22 · 122 阅读 · 0 评论 -
sqoop异常:Exception in thread "main" java.lang.NoClassDefFoundError: org/json/JSONObject
19/07/31 00:41:49 INFO mapreduce.ImportJobBase: Beginning import of city_infoException in thread “main” java.lang.NoClassDefFoundError: org/json/JSONObjectat org.apache.sqoop.util.SqoopJsonUtil.getJ...原创 2019-07-31 01:08:26 · 1088 阅读 · 0 评论 -
sqoop 导入 hive SemanticException [Error 10072]: Database does not exist
sqoop 导入hive 报错FAILED: SemanticException [Error 10072]: Database does not exist: xxxx解决方法:复制hive/conf下的hive-site.xml到sqoop工作目录的conf下实际上该database是在hive中存在的,由于sqoop下的配置文件太旧引起的,一般会出现在,换台机器执行sqoopCDH 默...原创 2019-07-31 01:35:16 · 2092 阅读 · 0 评论 -
sqoop导入hive表报错Could not load org.apache.hadoop.hive.conf.HiveConf.
sqoop导入hive表示报错19/07/31 01:16:17 ERROR hive.HiveConfig: Could not load org.apache.hadoop.hive.conf.HiveConf. Make sure HIVE_CONF_DIR is set correctly.19/07/31 01:16:17 ERROR tool.ImportTool: Encount...原创 2019-07-31 01:39:27 · 247 阅读 · 0 评论 -
Hive(六)生产上完成TopN统计
现有城市信息和产品信息两张表在MySQL中,另外有用户点击产品日志以文本形式存在hdfs上,现要求统计每个个城市区域下点击量前三的产品名,具体信息见下方。DROP TABLE city_info;CREATE TABLE city_info ( city_id int DEFAULT NULL, city_name varchar(255) DEFAULT NULL, area v...原创 2019-07-31 01:39:47 · 184 阅读 · 0 评论