![](https://img-blog.csdnimg.cn/20201014180756916.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
hadoop
sinat_19371493
这个作者很懒,什么都没留下…
展开
-
Hadoop 上处理join和group比较快但是逐条处理反而比较慢
发现在hadoop环境下,处理join原创 2014-08-14 13:06:54 · 528 阅读 · 0 评论 -
hadoop上优化速度可以采用改变outputDefinition为avro的方法
To optimise the performenc , after result validation, it is better let the intermediate output format as avro, need to do the setting in myenv.yamloutputDefinition:type: "avro"disableParalleli原创 2014-08-15 11:45:10 · 475 阅读 · 0 评论 -
Hadoop ecosystem自己的理解
Avro : Avro is a data serialization framework that is useful in Hadoop and other systems. The framework allows one to define schema which is language independent so that data can be interchanged bet原创 2014-09-28 13:36:28 · 535 阅读 · 0 评论 -
Workflow 工作经验之 jar extract error
- IOException: No such file or directoryERROR - RuntimeException: Unable to extract jar:file:/opt/vektor/lib/datarush-hadoop-cdh4-6.3.1-11.jar!/datarush-hadoop-cdh4/com.pervasive.datarush/hadoop-s原创 2014-11-12 18:39:06 · 513 阅读 · 0 评论 -
hadoop端口号和配置文件
webapp 一般为localhost的8088端口,当然也可以去原创 2014-10-15 11:12:36 · 1935 阅读 · 0 评论