排序:
默认
按更新时间
按访问量

java.lang.NoSuchMethodError

scala与spark 版本兼容的问题报错,无法运行 Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$col...

2018-11-13 20:48:40

阅读数:12

评论数:0

scala定长数组和可变数组

定长数组 def main(args: Array[String]): Unit = { //使用new创建定长8的数组,默认值和类型相关 val arr1 = new Array[Int](5) println(arr1) //打印地址 println(arr...

2018-11-06 20:21:59

阅读数:27

评论数:0

org.apache.flume.source.ExecSource$ExecRunnable.run(ExecSource.java:364)] Restarting in 10000ms

检查一下access.log的权限,给access.log赋权 chmod 777 access.log Creating hdfs://hadoop02:8020/flume/events 创建成功

2018-10-27 18:11:52

阅读数:16

评论数:0

nginx的安装部署

保证虚拟机能上网: 1、root用户登录 2、查看nginx安装信息:yum info nginx 3、如果找不到nginx信息,则执行如下: rpm -ivh http://nginx.org/packages/centos/6/noarch/RPMS/nginx-release-centos...

2018-10-27 15:58:49

阅读数:12

评论数:0

启动Hbase集群之后,无法开启主节点HMaster

先关闭hbase,不要用stop-hbase.sh,直接kill -9杀死其他集群节点上的HRegionServer和HMaster,然后检查时间,如果时间不同步的话就要同步时间,同步时间完之后重新开启start-hbase.sh ...

2018-10-20 17:30:28

阅读数:47

评论数:0

hive的调优

1、limit的限制: hive.limit.optimize.enable=false; 建议设置true hive.limit.row.max.size=100000; hive.limit.optimize.limit.file=10; hive.limit.optimize.fetch....

2018-10-17 22:59:37

阅读数:82

评论数:1

mapreduce Top_N

/* 求统计结果的前3名: hadoop hadoop hadoop hadoop hadoop is ok is nice is better spark hbase hive flume nice 输出: hadoop 5 is 3 nice 2 */ * 自定义数据类型...

2018-10-13 10:53:46

阅读数:10

评论数:0

Type mismatch in value from map: expected org.apache.hadoop.io.Text, received org.apache.hadoop.io.

一般是map阶段的keyout或者valueout与主函数 job.setMapOutputKeyClass job.setMapOutputValueClass 不匹配,需认真检查

2018-10-13 10:49:06

阅读数:16

评论数:0

mapreduce倒排索引

/** 倒排索引: 数据: index.html hadoop hadoop hadoop is nice is good hadoop hadoop hadoop-info.html hadoop hadoop hadoop is better spark-info.html ...

2018-10-10 21:03:16

阅读数:68

评论数:1

org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.io.Text

public static class MyMapper extends Mapper<Text,Text,Text,IntWritable>{ 解决办法:将Text改为Obj或者LonWritable public static cla...

2018-10-10 19:05:57

阅读数:65

评论数:0

Could not load org.apache.hadoop.hive.conf.HiveConf. Make sure HIVE_CONF_DIR

ERROR hive.HiveConfig: Could not load org.apache.hadoop.hive.conf.HiveConf. Make sure HIVE_CONF_DIR is set correctly. 18/09/29 22:06:05 ERROR tool.Im...

2018-09-30 09:09:55

阅读数:34

评论数:0

无法将文件导入到HDFS上的hive/warehouse路径下

上传文件到hive上,能上传成功但是在hive/warehouse/下查找不到,在上传成功之后提示错误信息: FAILED: SemanticException [Error 10072]: Database does not exist: 将apache-hive-1.2.2-bin/conf/...

2018-09-28 15:41:18

阅读数:41

评论数:0

Error: Could not open client transport with JDBC Uri

Error: Could not open client transport with JDBC Uri: jdbc:hive2://IP: java.net.ConnectException: Connection refused Linux当中hiveServer2没有启动起来: 1.临时启动...

2018-09-28 12:05:17

阅读数:72

评论数:0

提示
确定要删除当前文章?
取消 删除
关闭
关闭