distribute computing
stephen80
这个作者很懒,什么都没留下…
展开
-
算法是个重要问题
o(n) ,o(lgn) 是一个重要的问题。如果,n 太大不能承受,可以考虑限制。原创 2009-04-09 09:43:02 · 90 阅读 · 0 评论 -
mysql reinstall
rpm -qa myql mysql-4.1.20-2.RHEL4.1.0.1mysql --version rpm -e mysql-4.1.20-2.RHEL4.1.0.1 --nodepscat /proc/cpuinfocat /var/log/dmesg 2 Linux version 2.6.9-67.ELsmp (brewbu...原创 2009-08-05 11:44:24 · 247 阅读 · 0 评论 -
hadoop 相关的收获
最近项目的收获1。hadoop jar hadoop-0.19.1-examples.jar pi 10 100原因是META: Main-class 指定了 ExampleDriver。2。MeregSort ,QuickSort ,Heap 的 algorithm complexity. comparator 耗资源3。java concurrent 能用...原创 2009-08-04 19:52:49 · 119 阅读 · 0 评论 -
编写jvm
今天看到,国外有好多开源jvm。恩作distribute computing, 也许jvm 需要自己编。ladyvm.pdfterracotta。原创 2009-02-10 11:41:58 · 426 阅读 · 0 评论 -
a java map reduce framework
implement a map reduce framework. hadoop's coding is ugly. so i'd like to implment another one.太极拳宁循理以求精,莫越理以争胜。需无我以从人,莫舍近而求远。拟善心以布道,莫执著于两端。揣摩以悟空,莫妄动而伤神。发劲似射箭,箭去无踪影。宁愿饿饭...原创 2009-06-22 18:08:05 · 89 阅读 · 0 评论 -
zookeeper 性能
zookerper 群,3台机器写测试50 thread 每个 thread 200,2台机器 .with 1 read .20000 /13203 , 1514write /s .client 增加不会明显降低单机写性能。高效。原创 2008-12-08 15:26:32 · 104 阅读 · 0 评论 -
got a product idea about cloud manager
Today, write a PPT.RightScale maybe the big player.A single unified interface to architect, manage and monitor cloud computing environment For cloud end user原创 2009-06-05 16:10:43 · 81 阅读 · 0 评论 -
bdb 性能测试
berkleydb test.1m 数据. 写5m row , 5m/1657878ms ,30000 row/s . 读:getByHost, 2803 row , 34508ms .5m 数据写5m row , 5m /17689168 ms , 282row /s. 读:getByHost, 5287row , 133616 ms10m 数据写 1k row,...原创 2008-12-02 10:18:04 · 307 阅读 · 0 评论 -
Hbase 性能测试
hbase performance * test hadoop0.18.1,hbase0.18.11master,4 region server (dual core cpu,dual cpu?)已经有2m 数据 random write 1 client, Finished randomWrite in 499001ms at offset 0 for ...原创 2008-12-02 10:16:49 · 102 阅读 · 0 评论 -
hadoop02 有不少变化,直接在windows,eclipse 环境下
windows 在eclipse 下run wordcount;需要:1. 安装cygwin2. 把 cygwin/bin 放到 windows 环境变量 pathhadoop start up1。下载 ,tar2。修改 con/hadoop-env.sh , java_home3. bin/hadoop 显示帮助4。运行 word count mkdir...原创 2009-05-21 20:11:19 · 84 阅读 · 0 评论 -
hadoop tut
downloadtar -xzf vi conf/hadooop-evn.sh: java_home=bin/hadoopmkdir -p temp/inputcp conf/*.xml temp/input bin/hadoop jar hadoop-*-examples.jar grep temp/input temp/output 'dfs[a-z.]+'cat ...原创 2010-06-03 11:19:16 · 121 阅读 · 0 评论