hadoop测试用例
飞火流云
这个作者很懒,什么都没留下…
展开
-
TeraSort_Hadoop_排序
数据生成: hadoop jar hadoop-mapreduce-examples-2.0.3-alpha.jar teragen 10000000 /liuqiang/terasort/1G/ 排序: hadoop jar hadoop-mapreduce-examples-2.0.3-alpha.jar terasort /liuqiang/terasort/1原创 2013-03-19 20:07:15 · 992 阅读 · 2 评论 -
hadoop 测试
MRBenchmark.0.0.2Usage: mrbench [-baseDir ] [-jar ] [-numRuns ] [-maps ] [-reduces ] [-inputLines ] [-inputType ] [-verbose][liuqiang@node01 hadoop-1.0.3]$ hadoop jar hadoop-test-1.0原创 2013-09-14 15:52:50 · 1138 阅读 · 0 评论 -
hadoop-1.0.3 mrbenchc测试用例
hadoop jar hadoop-test-1.0.3.jar mrbench -inputLines 500 -maps 8 -reduces 50 注意, inputLines 选项默认为1, 如果不设的话,会导致输入数据过小,则后面无论你maps参数设置多少,在作业初始化时InputFormat的getSplits函数都会因为数据过小将maps设置为默认值2, 查了1个小时才查明原创 2013-10-14 19:59:17 · 1095 阅读 · 0 评论 -
运行Hibench出现的问题
, Status : FAILEDError: Java heap space 解决方法:设置合适的mapred.child.java.opts,我设置成400m解决此问题,但是设置为300m仍然出错。mapred.child.java.opts-Xmx400mJava opts for the task tracker child processes. Th转载 2013-03-20 20:41:38 · 1641 阅读 · 0 评论 -
关于gridmix3(Gridmix3 – Emulating Production Workload for Apache Hadoop)
转自: 前言:http://blog.csdn.net/zhaomirong/article/details/7818922Tracking, modeling, and mimicking this adaptive, complex workload is a prerequisite to effective performance engineering.gridmix的转载 2013-11-03 14:32:30 · 1196 阅读 · 0 评论