Twitter Storm开篇之作

Storm介绍

Twitter将Storm正式开源了,这是一个分布式的、容错的实时计算系统,它被托管在GitHub上,遵循 Eclipse Public License 1.0。Storm是由BackType开发的实时处理系统,BackType现在已在Twitter麾下。GitHub上的最新版本是Storm 0.5.2,基本是用Clojure写的。

Storm为分布式实时计算提供了一组通用原语,可被用于“流处理”之中,实时处理消息并更新数据库。这是管理队列及工作者集群的另一种方式。 Storm也可被用于“连续计算”(continuous computation),对数据流做连续查询,在计算时就将结果以流的形式输出给用户。它还可被用于“分布式RPC”,以并行的方式运行昂贵的运算。 Storm的主工程师Nathan Marz表示:

Storm可以方便地在一个计算机集群中编写与扩展复杂的实时计算,Storm之于实时处理,就好比  Hadoop之于批处理。Storm保证每个消息都会得到处理,而且它很快——在一个小集群中,每秒可以处理数以百万计的消息。更棒的是你可以使用任意编程语言来做开发。

Storm的主要特点如下:

  1. 简单的编程模型。类似于MapReduce降低了并行批处理复杂性,Storm降低了进行实时处理的复杂性。
  2. 可以使用各种编程语言。你可以在Storm之上使用各种编程语言。默认支持Clojure、Java、Ruby和Python。要增加对其他语言的支持,只需实现一个简单的Storm通信协议即可。
  3. 容错性。Storm会管理工作进程和节点的故障。
  4. 水平扩展。计算是在多个线程、进程和服务器之间并行进行的。
  5. 可靠的消息处理。Storm保证每个消息至少能得到一次完整处理。任务失败时,它会负责从消息源重试消息。
  6. 快速。系统的设计保证了消息能得到快速的处理,使用ØMQ作为其底层消息队列。
  7. 本地模式。Storm有一个“本地模式”,可以在处理过程中完全模拟Storm集群。这让你可以快速进行开发和单元测试。

Storm集群由一个主节点和多个工作节点组成。主节点运行了一个名为“Nimbus”的守护进程,用于分配代码、布置任务及故障检测。每个工作节 点都运行了一个名为“Supervisor”的守护进程,用于监听工作,开始并终止工作进程。Nimbus和Supervisor都能快速失败,而且是无 状态的,这样一来它们就变得十分健壮,两者的协调工作是由Apache ZooKeeper来完成的。

Storm的术语包括Stream、Spout、Bolt、Task、Worker、Stream Grouping和Topology。Stream是被处理的数据。Sprout是数据源。Bolt处理数据。Task是运行于Spout或Bolt中的 线程。Worker是运行这些线程的进程。Stream Grouping规定了Bolt接收什么东西作为输入数据。数据可以随机分配(术语为Shuffle),或者根据字段值分配(术语为Fields),或者 广播(术语为All),或者总是发给一个Task(术语为Global),也可以不关心该数据(术语为None),或者由自定义逻辑来决定(术语为 Direct)。Topology是由Stream Grouping连接起来的Spout和Bolt节点网络。在Storm Concepts页面里对这些术语有更详细的描述。

可以和Storm相提并论的系统有Esper、Streambase、HStreaming和Yahoo S4。其中和Storm最接近的就是S4。两者最大的区别在于Storm会保证消息得到处理。这些系统中有的拥有内建数据存储层,这是Storm所没有的,如果需要持久化,可以使用一个类似于Cassandra或Riak这样的外部数据库。

入门的最佳途径是阅读GitHub上的官方《Storm Tutorial》。 其中讨论了多种Storm概念和抽象,提供了范例代码以便你可以运行一个Storm Topology。开发过程中,可以用本地模式来运行Storm,这样就能在本地开发,在进程中测试Topology。一切就绪后,以远程模式运行 Storm,提交用于在集群中运行的Topology。Maven用户可以使用clojars.org提供的Storm依赖,地址是 http://clojars.org/repo。

要运行Storm集群,你需要Apache Zookeeper、ØMQ、JZMQ、Java 6和Python 2.6.6。ZooKeeper用于管理集群中的不同组件,ØMQ是内部消息系统,JZMQ是ØMQ的Java Binding。有个名为storm-deploy的子项目,可以在AWS上一键部署Storm集群。关于详细的步骤,可以阅读Storm Wiki上的《Setting up a Storm cluster》。

本软件介绍内容来自 InfoQ

 Storm学习途径

作者:量子恒道          网址:http://blog.linezing.com/

Storm简单例子

通过阅读以上两位高人的文章,就试着写了一个简单demo

通过demo主要来掌握storm的运行流程是怎样的

首先新建一个Person 对象,主要是用来将其封装为数据源进行传输

[java]  view plain copy
  1. /** 
  2.  * Person.java 
  3.  * 版权所有(C) 2013  
  4.  * 创建:cuiran 2013-01-15 15:49:25 
  5.  */  
  6. package com.stormdemo.demo;  
  7.   
  8. import java.io.Serializable;  
  9.   
  10. /** 
  11.  * TODO 
  12.  * @author cuiran 
  13.  * @version TODO 
  14.  */  
  15. public class Person implements Serializable {  
  16.   
  17.     /** 
  18.      *  
  19.      */  
  20.     private static final long serialVersionUID = -2279602642375811203L;  
  21.     private Long id;  
  22.     private String name;  
  23.     private Integer age;  
  24.     /** 
  25.      * @return the id 
  26.      */  
  27.     public Long getId() {  
  28.         return id;  
  29.     }  
  30.     /** 
  31.      * @param id the id to set 
  32.      */  
  33.     public void setId(Long id) {  
  34.         this.id = id;  
  35.     }  
  36.     /** 
  37.      * @return the name 
  38.      */  
  39.     public String getName() {  
  40.         return name;  
  41.     }  
  42.     /** 
  43.      * @param name the name to set 
  44.      */  
  45.     public void setName(String name) {  
  46.         this.name = name;  
  47.     }  
  48.     /** 
  49.      * @return the age 
  50.      */  
  51.     public Integer getAge() {  
  52.         return age;  
  53.     }  
  54.     /** 
  55.      * @param age the age to set 
  56.      */  
  57.     public void setAge(Integer age) {  
  58.         this.age = age;  
  59.     }  
  60.       
  61.     public String toString(){  
  62.         return "[Person id="+id+" name="+name+" age="+age+"]";  
  63.     }  
  64. }  


然后设置数据源实现接口IRichSpout,在这个类中首先是需要设置输出字段,然后是在open方法中将存放有Person对象的集合进行迭代然后放入queue队列中,在nextTuple方法中从队列中取出Person对象并emit发送给Bolt处理。

 

[java]  view plain copy
  1. /** 
  2.  * DemoSpout.java 
  3.  * 版权所有(C) 2013  
  4.  * 创建:cuiran 2013-01-15 15:43:26 
  5.  */  
  6. package com.stormdemo.demo;  
  7.   
  8. import java.util.Iterator;  
  9. import java.util.LinkedList;  
  10. import java.util.List;  
  11. import java.util.Map;  
  12. import java.util.Queue;  
  13.   
  14. import org.apache.commons.logging.Log;  
  15. import org.apache.commons.logging.LogFactory;  
  16.   
  17.   
  18.   
  19. import backtype.storm.spout.SpoutOutputCollector;  
  20. import backtype.storm.task.TopologyContext;  
  21. import backtype.storm.topology.IRichSpout;  
  22. import backtype.storm.topology.OutputFieldsDeclarer;  
  23. import backtype.storm.tuple.Fields;  
  24. import backtype.storm.tuple.Values;  
  25.   
  26. /** 
  27.  * TODO 
  28.  * @author cuiran 
  29.  * @version TODO 
  30.  */  
  31. public class DemoSpout implements IRichSpout {  
  32.   
  33.     /** 
  34.      *  
  35.      */  
  36.     private static final long serialVersionUID = 3980242432526476937L;  
  37.     private static Log log = LogFactory.getLog(DemoSpout.class.getName());  
  38.     Queue<Person> queues = new LinkedList<Person>();  
  39.     List<Person> list=null;  
  40.       
  41.     private SpoutOutputCollector collector;  
  42.     private Map conf;  
  43.     private TopologyContext context;  
  44.   
  45.   
  46.     /* (non-Javadoc) 
  47.      * @see backtype.storm.topology.IRichSpout#isDistributed() 
  48.      */  
  49.   
  50.   
  51.     /* (non-Javadoc) 
  52.      * @see backtype.storm.spout.ISpout#ack(java.lang.Object) 
  53.      */  
  54.     @Override  
  55.     public void ack(Object arg0) {  
  56.         // TODO Auto-generated method stub  
  57.         log.debug("ack-----> "+arg0);  
  58.     }  
  59.   
  60.     /* (non-Javadoc) 
  61.      * @see backtype.storm.spout.ISpout#close() 
  62.      */  
  63.     @Override  
  64.     public void close() {  
  65.         // TODO Auto-generated method stub  
  66.         log.debug("close-----> ");  
  67.     }  
  68.   
  69.     /* (non-Javadoc) 
  70.      * @see backtype.storm.spout.ISpout#fail(java.lang.Object) 
  71.      */  
  72.     @Override  
  73.     public void fail(Object arg0) {  
  74.         // TODO Auto-generated method stub  
  75.         log.debug("fail-----> "+arg0);  
  76.     }  
  77.   
  78.     /* (non-Javadoc) 
  79.      * @see backtype.storm.spout.ISpout#nextTuple() 
  80.      */  
  81.     @Override  
  82.     public void nextTuple() {  
  83.         // TODO Auto-generated method stub  
  84.         Person p= queues.poll();  
  85.         if(p!=null){  
  86.             log.debug("nextTuple----> 发送数据,用户ID="+p.getId());  
  87.             collector.emit(new Values(p), p);  
  88.         }  
  89.           
  90.     }  
  91.   
  92.     /* (non-Javadoc) 
  93.      * @see backtype.storm.spout.ISpout#open(java.util.Map, backtype.storm.task.TopologyContext, backtype.storm.spout.SpoutOutputCollector) 
  94.      */  
  95.     @Override  
  96.     public void open(Map map, TopologyContext context, SpoutOutputCollector collector) {  
  97.         // TODO Auto-generated method stub  
  98.         log.debug("spout-----> 将集合数据转换至队列中");  
  99.         this.collector = collector;  
  100.         this.conf = conf;  
  101.         this.context = context;  
  102.           
  103.         Iterator<Person> it= list.iterator();  
  104.         while(it.hasNext()){  
  105.             Person p=it.next();  
  106.             queues.add(p);  
  107.         }  
  108.     }  
  109.   
  110.     /* (non-Javadoc) 
  111.      * @see backtype.storm.topology.IComponent#declareOutputFields(backtype.storm.topology.OutputFieldsDeclarer) 
  112.      */  
  113.     @Override  
  114.     public void declareOutputFields(OutputFieldsDeclarer declarer) {  
  115.         // TODO Auto-generated method stub  
  116.         log.debug("declareOutputFields----> 设置输出字段");  
  117.         declarer.declare(new Fields("person"));  
  118.     }  
  119.   
  120.     public DemoSpout(List<Person> list) {  
  121.         super();  
  122.         this.list = list;  
  123.     }  
  124.   
  125.     /* (non-Javadoc) 
  126.      * @see backtype.storm.spout.ISpout#activate() 
  127.      */  
  128.     @Override  
  129.     public void activate() {  
  130.         // TODO Auto-generated method stub  
  131.           
  132.     }  
  133.   
  134.     /* (non-Javadoc) 
  135.      * @see backtype.storm.spout.ISpout#deactivate() 
  136.      */  
  137.     @Override  
  138.     public void deactivate() {  
  139.         // TODO Auto-generated method stub  
  140.           
  141.     }  
  142.   
  143.     /* (non-Javadoc) 
  144.      * @see backtype.storm.topology.IComponent#getComponentConfiguration() 
  145.      */  
  146.     @Override  
  147.     public Map<String, Object> getComponentConfiguration() {  
  148.         // TODO Auto-generated method stub  
  149.         return null;  
  150.     }  
  151.   
  152. }  

接着新建一个处理数据的Bolt,主要是在execute方法中通过之前设置的字段person,获取当前传输的对象(此处需要主要的是storm早期版本貌似不能传输对象,我后来采用的是当前最新版本 0.8版本也可以这样)。然后进行处理,处理成功会调用ack方法,若失败则调用fail方法。

[java]  view plain copy
  1. /** 
  2.  * ListBolt.java 
  3.  * 版权所有(C) 2013  
  4.  * 创建:cuiran 2013-01-15 16:05:25 
  5.  */  
  6. package com.stormdemo.demo;  
  7.   
  8. import java.util.Map;  
  9.   
  10. import org.apache.commons.logging.Log;  
  11. import org.apache.commons.logging.LogFactory;  
  12.   
  13. import backtype.storm.task.OutputCollector;  
  14. import backtype.storm.task.TopologyContext;  
  15. import backtype.storm.topology.IRichBolt;  
  16. import backtype.storm.topology.OutputFieldsDeclarer;  
  17. import backtype.storm.tuple.Tuple;  
  18.   
  19. /** 
  20.  * TODO 
  21.  * @author cuiran 
  22.  * @version TODO 
  23.  */  
  24. public class ListBolt implements IRichBolt {  
  25.   
  26.     /** 
  27.      *  
  28.      */  
  29.     private static final long serialVersionUID = 6467077126541265761L;  
  30.       
  31.     private static Log log = LogFactory.getLog(ListBolt.class.getName());  
  32.       
  33.     private OutputCollector collector;  
  34.   
  35.     /* (non-Javadoc) 
  36.      * @see backtype.storm.task.IBolt#cleanup() 
  37.      */  
  38.     @Override  
  39.     public void cleanup() {  
  40.         // TODO Auto-generated method stub  
  41.   
  42.     }  
  43.   
  44.     /* (non-Javadoc) 
  45.      * @see backtype.storm.task.IBolt#execute(backtype.storm.tuple.Tuple) 
  46.      */  
  47.     @Override  
  48.     public void execute(Tuple tuple) {  
  49.         // TODO Auto-generated method stub  
  50.         try {  
  51.             log.debug("execute----->处理数据");  
  52.             Person p= (Person)tuple.getValueByField("person");  
  53.               
  54.             log.debug("处理数据  用户="+p.toString());  
  55.               
  56.             collector.ack(tuple);  
  57.         }catch (Exception e) {  
  58.             collector.fail(tuple);  
  59.             // TODO: handle exception  
  60.             log.error("处理数据出现异常", e);  
  61.         }  
  62.           
  63.     }  
  64.   
  65.     /* (non-Javadoc) 
  66.      * @see backtype.storm.task.IBolt#prepare(java.util.Map, backtype.storm.task.TopologyContext, backtype.storm.task.OutputCollector) 
  67.      */  
  68.     @Override  
  69.     public void prepare(Map map, TopologyContext context, OutputCollector collector) {  
  70.         // TODO Auto-generated method stub  
  71.         this.collector=collector;  
  72.     }  
  73.   
  74.     /* (non-Javadoc) 
  75.      * @see backtype.storm.topology.IComponent#declareOutputFields(backtype.storm.topology.OutputFieldsDeclarer) 
  76.      */  
  77.     @Override  
  78.     public void declareOutputFields(OutputFieldsDeclarer declarer) {  
  79.         // TODO Auto-generated method stub  
  80.   
  81.     }  
  82.   
  83.     /* (non-Javadoc) 
  84.      * @see backtype.storm.topology.IComponent#getComponentConfiguration() 
  85.      */  
  86.     @Override  
  87.     public Map<String, Object> getComponentConfiguration() {  
  88.         // TODO Auto-generated method stub  
  89.         return null;  
  90.     }  
  91.   
  92. }  


最后就是我们的测试类:由于启动storm后一直运行,若需要停止需要kill掉,我们测试时候就是用的

cluster.killTopology("test");
 cluster.shutdown();

需要注意的是在setSpout和setBolt方法中第一个参数id在早期版本是int类型,后期版本就改为string了。

[java]  view plain copy
  1. /** 
  2.  * DemoTopology.java 
  3.  * 版权所有(C) 2013  
  4.  * 创建:cuiran 2013-01-15 16:13:27 
  5.  */  
  6. package com.stormdemo.demo;  
  7.   
  8. import java.util.ArrayList;  
  9. import java.util.List;  
  10.   
  11. import org.apache.commons.logging.Log;  
  12. import org.apache.commons.logging.LogFactory;  
  13.   
  14. import backtype.storm.Config;  
  15. import backtype.storm.LocalCluster;  
  16. import backtype.storm.generated.StormTopology;  
  17. import backtype.storm.topology.TopologyBuilder;  
  18. import backtype.storm.utils.Utils;  
  19. import junit.framework.TestCase;  
  20.   
  21. /** 
  22.  * TODO 
  23.  * @author cuiran 
  24.  * @version TODO 
  25.  */  
  26. public class DemoTopology extends TestCase {  
  27.       
  28.     private static Log log = LogFactory.getLog(DemoTopology.class.getName());  
  29.       
  30.     public static StormTopology buildTopology(List<Person> list) {  
  31.         TopologyBuilder builder = new TopologyBuilder();  
  32.           
  33.         builder.setSpout("1"new DemoSpout(list));  
  34.           
  35.         builder.setBolt("2"new ListBolt()).globalGrouping("1");  
  36.           
  37.         return builder.createTopology();  
  38.     }  
  39.       
  40.     public static List<Person> getPerson(){  
  41.         List<Person> list=new ArrayList<Person>();  
  42.           
  43.         for(int i=1;i<10;i++){  
  44.             Person p=new Person();  
  45.             p.setId((long)i);  
  46.             p.setName("zhang"+i);  
  47.             p.setAge(20+i);  
  48.               
  49.             list.add(p);  
  50.         }  
  51.           
  52.           
  53.         return list;  
  54.     }  
  55.       
  56.     public static List<String> getStr(){  
  57.         List<String> list=new ArrayList<String>();  
  58.           
  59.         for(int i=1;i<10;i++){  
  60.               
  61.             list.add("test"+i);  
  62.         }  
  63.           
  64.         return list;  
  65.     }  
  66.       
  67.     public void testTopology(){  
  68.         log.debug("stormdemo开始");  
  69.         long startTime=System.currentTimeMillis();  
  70.         Config conf = new Config();  
  71.         conf.setDebug(true);  
  72.         conf.setNumWorkers(2);  
  73.         conf.setMaxSpoutPending(1);  
  74.         LocalCluster cluster = new LocalCluster();  
  75.         List<Person> list=getPerson();  
  76.   
  77.           
  78.           
  79.         cluster.submitTopology("demo", conf, buildTopology(list));  
  80.         long executeTime=System.currentTimeMillis();  
  81.         Utils.sleep(30000);  
  82.         log.debug("stormdemo结束");  
  83.         long stopTime=System.currentTimeMillis();  
  84.           
  85.         log.debug("共消耗时间:运行="+(executeTime-startTime)+",总时间:"+(stopTime-startTime)+"");  
  86.           
  87.         cluster.killTopology("test");  
  88.         cluster.shutdown();  
  89.           
  90.           
  91.     }  
  92. }  

最后运行结果:

[plain]  view plain copy
  1. log4j:ERROR Could not find value for key log4j.appender.fileout  
  2. log4j:ERROR Could not instantiate appender named "fileout".  
  3. 2013-01-16 09:20:42:DEBUG com.stormdemo.demo.DemoTopology - stormdemo开始  
  4. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 GMT  
  5. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=PC2010110311cvt  
  6. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.6.0_01  
  7. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Sun Microsystems Inc.  
  8. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=D:\Java\jre1.6.0_01  
  9. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=D:\workspace\stormdemo1\WebRoot\WEB-INF\classes;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clout-0.4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-exec-1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-fileupload-1.2.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-io-1.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\compojure-0.6.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\core.incubator-0.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\hiccup-0.3.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jetty-6.1.26.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jetty-util-6.1.26.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jline-0.9.94.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\json-simple-1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\junit-3.8.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jzmq-2.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\log4j-1.2.16.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-core-0.3.10.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-jetty-adapter-0.3.11.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-servlet-0.3.11.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\servlet-api-2.5-20081211.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\servlet-api-2.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.macro-0.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\asm-4.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\carbonite-1.5.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clj-time-0.4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clojure-1.4.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-codec-1.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-lang-2.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-logging-1.1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\curator-client-1.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\curator-framework-1.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\disruptor-2.10.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\guava-13.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\httpclient-4.1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\httpcore-4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jgrapht-0.8.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\joda-time-2.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\kryo-2.17.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\libthrift7-0.7.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\log4j-over-slf4j-1.6.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\logback-classic-1.0.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\logback-core-1.0.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\math.numeric-tower-0.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\minlog-1.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\objenesis-1.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\reflectasm-1.07-shaded.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\slf4j-api-1.6.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\snakeyaml-1.9.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.cli-0.2.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.logging-0.2.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\zookeeper-3.3.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\storm-0.9.0-wip7.jar;/D:/MyEclipse 6.6/eclipse/configuration/org.eclipse.osgi/bundles/543/1/.cp/;/D:/MyEclipse 6.6/eclipse/configuration/org.eclipse.osgi/bundles/541/1/.cp/  
  10. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=D:\Java\jre1.6.0_01\bin;.;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;D:\Java\jdk1.6.0_01\bin;e:\oracle\product\10.2.0\client_1\bin;d:\oracle\product\10.2.0\client_1\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;D:\Program Files\TortoiseSVN\bin;;C:\Program Files\Common Files\Thunder Network\KanKan\Codecs;E:\ant182\bin;C:\Program Files\Java\jdk1.6.0_01\bin;;C:\Program Files\Android\android-sdk-windows\platform-tools;c:\php\ext;D:\Java\jdk1.6.0_01;C:\Program Files\MySQL\MySQL Server 5.1\bin;D:\Program Files\TortoiseSVN\bin;C:\Program Files\Microsoft SQL Server\80\Tools\Binn\;C:\Program Files\Microsoft SQL Server\90\Tools\binn\;C:\Program Files\Microsoft SQL Server\90\DTS\Binn\;C:\Program Files\Microsoft SQL Server\90\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files\Microsoft Visual Studio 8\Common7\IDE\PrivateAssemblies\;D:\Ruby193\bin;D:\PHP;D:\PHP\ext;D:\Maven\bin  
  11. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\  
  12. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>  
  13. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Windows XP  
  14. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=x86  
  15. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=5.1  
  16. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=Administrator  
  17. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=C:\Documents and Settings\Administrator  
  18. 2013-01-16 09:20:45:INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=D:\workspace\stormdemo1  
  19. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 GMT  
  20. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:host.name=PC2010110311cvt  
  21. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.version=1.6.0_01  
  22. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.vendor=Sun Microsystems Inc.  
  23. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.home=D:\Java\jre1.6.0_01  
  24. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.class.path=D:\workspace\stormdemo1\WebRoot\WEB-INF\classes;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clout-0.4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-exec-1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-fileupload-1.2.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-io-1.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\compojure-0.6.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\core.incubator-0.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\hiccup-0.3.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jetty-6.1.26.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jetty-util-6.1.26.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jline-0.9.94.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\json-simple-1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\junit-3.8.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jzmq-2.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\log4j-1.2.16.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-core-0.3.10.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-jetty-adapter-0.3.11.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\ring-servlet-0.3.11.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\servlet-api-2.5-20081211.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\servlet-api-2.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.macro-0.1.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\asm-4.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\carbonite-1.5.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clj-time-0.4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\clojure-1.4.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-codec-1.4.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-lang-2.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\commons-logging-1.1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\curator-client-1.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\curator-framework-1.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\disruptor-2.10.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\guava-13.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\httpclient-4.1.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\httpcore-4.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\jgrapht-0.8.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\joda-time-2.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\kryo-2.17.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\libthrift7-0.7.0.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\log4j-over-slf4j-1.6.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\logback-classic-1.0.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\logback-core-1.0.6.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\math.numeric-tower-0.0.1.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\minlog-1.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\objenesis-1.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\reflectasm-1.07-shaded.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\slf4j-api-1.6.5.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\snakeyaml-1.9.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.cli-0.2.2.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\tools.logging-0.2.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\zookeeper-3.3.3.jar;D:\workspace\stormdemo1\WebRoot\WEB-INF\lib\storm-0.9.0-wip7.jar;/D:/MyEclipse 6.6/eclipse/configuration/org.eclipse.osgi/bundles/543/1/.cp/;/D:/MyEclipse 6.6/eclipse/configuration/org.eclipse.osgi/bundles/541/1/.cp/  
  25. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.library.path=D:\Java\jre1.6.0_01\bin;.;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;D:\Java\jdk1.6.0_01\bin;e:\oracle\product\10.2.0\client_1\bin;d:\oracle\product\10.2.0\client_1\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;D:\Program Files\TortoiseSVN\bin;;C:\Program Files\Common Files\Thunder Network\KanKan\Codecs;E:\ant182\bin;C:\Program Files\Java\jdk1.6.0_01\bin;;C:\Program Files\Android\android-sdk-windows\platform-tools;c:\php\ext;D:\Java\jdk1.6.0_01;C:\Program Files\MySQL\MySQL Server 5.1\bin;D:\Program Files\TortoiseSVN\bin;C:\Program Files\Microsoft SQL Server\80\Tools\Binn\;C:\Program Files\Microsoft SQL Server\90\Tools\binn\;C:\Program Files\Microsoft SQL Server\90\DTS\Binn\;C:\Program Files\Microsoft SQL Server\90\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files\Microsoft Visual Studio 8\Common7\IDE\PrivateAssemblies\;D:\Ruby193\bin;D:\PHP;D:\PHP\ext;D:\Maven\bin  
  26. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.io.tmpdir=C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\  
  27. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:java.compiler=<NA>  
  28. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:os.name=Windows XP  
  29. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:os.arch=x86  
  30. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:os.version=5.1  
  31. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:user.name=Administrator  
  32. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:user.home=C:\Documents and Settings\Administrator  
  33. 2013-01-16 09:20:45:INFO org.apache.zookeeper.server.ZooKeeperServer - Server environment:user.dir=D:\workspace\stormdemo1  
  34. 2013-01-16 09:20:47:INFO org.apache.zookeeper.server.ZooKeeperServer - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\a79a4c6f-b820-4d54-85e2-212abbd237f6\version-2 snapdir C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\a79a4c6f-b820-4d54-85e2-212abbd237f6\version-2  
  35. 2013-01-16 09:20:47:INFO org.apache.zookeeper.server.NIOServerCnxn - binding to port 0.0.0.0/0.0.0.0:2000  
  36. 3312 [main] INFO  backtype.storm.zookeeper - Starting inprocess zookeeper at port 2000 and dir C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\/a79a4c6f-b820-4d54-85e2-212abbd237f6  
  37. 2013-01-16 09:20:47:INFO org.apache.zookeeper.server.persistence.FileTxnSnapLog - Snapshotting: 0  
  38. 3734 [main] INFO  backtype.storm.daemon.nimbus - Starting Nimbus with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/905e5ab3-42c8-47ef-9687-322ffe72a619", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}  
  39. 3765 [main] INFO  backtype.storm.daemon.nimbus - Using default scheduler  
  40. 3859 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  41. 2013-01-16 09:20:47:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@46a09b  
  42. 2013-01-16 09:20:47:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  43. 2013-01-16 09:20:47:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  44. 2013-01-16 09:20:47:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2006  
  45. 2013-01-16 09:20:47:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2006  
  46. 2013-01-16 09:20:47:INFO org.apache.zookeeper.server.persistence.FileTxnLog - Creating new log file: log.1  
  47. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720000 with negotiated timeout 20000 for client /127.0.0.1:2006  
  48. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720000, negotiated timeout = 20000  
  49. 4546 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none  
  50. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b2720000  
  51. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b2720000 closed  
  52. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down  
  53. 2013-01-16 09:20:48:WARN org.apache.zookeeper.server.NIOServerCnxn - EndOfStreamException: Unable to read additional data from client sessionid 0x13c40f1b2720000, likely client has closed socket  
  54. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2006 which had sessionid 0x13c40f1b2720000  
  55. 4625 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  56. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@1eea7f0  
  57. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  58. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2009  
  59. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  60. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2009  
  61. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720001 with negotiated timeout 20000 for client /127.0.0.1:2009  
  62. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720001, negotiated timeout = 20000  
  63. 4796 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  64. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@62be97  
  65. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  66. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2013  
  67. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  68. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2013  
  69. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720002 with negotiated timeout 20000 for client /127.0.0.1:2013  
  70. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720002, negotiated timeout = 20000  
  71. 4843 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none  
  72. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b2720002  
  73. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b2720002 closed  
  74. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down  
  75. 4859 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  76. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2013 which had sessionid 0x13c40f1b2720002  
  77. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@d8e902  
  78. 4859 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  79. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@6c08b2  
  80. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  81. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2016  
  82. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  83. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2016  
  84. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  85. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2019  
  86. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  87. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2019  
  88. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720003 with negotiated timeout 20000 for client /127.0.0.1:2016  
  89. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720003, negotiated timeout = 20000  
  90. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720004, negotiated timeout = 20000  
  91. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720004 with negotiated timeout 20000 for client /127.0.0.1:2019  
  92. 4890 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none  
  93. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b2720004  
  94. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b2720004 closed  
  95. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down  
  96. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2019 which had sessionid 0x13c40f1b2720004  
  97. 4906 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  98. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@164804  
  99. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  100. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2023  
  101. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  102. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2023  
  103. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720005 with negotiated timeout 20000 for client /127.0.0.1:2023  
  104. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720005, negotiated timeout = 20000  
  105. 4953 [main] INFO  backtype.storm.daemon.supervisor - Starting Supervisor with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/dd108ee9-8f33-4324-9ef7-7b3b2f443f23", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1 2 3), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}  
  106. 5031 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  107. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@19d794d  
  108. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  109. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  110. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2026  
  111. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2026  
  112. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720006 with negotiated timeout 20000 for client /127.0.0.1:2026  
  113. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720006, negotiated timeout = 20000  
  114. 5062 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none  
  115. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b2720006  
  116. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b2720006 closed  
  117. 2013-01-16 09:20:48:WARN org.apache.zookeeper.server.NIOServerCnxn - EndOfStreamException: Unable to read additional data from client sessionid 0x13c40f1b2720006, likely client has closed socket  
  118. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down  
  119. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2026 which had sessionid 0x13c40f1b2720006  
  120. 5078 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  121. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@d713fe  
  122. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  123. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2030  
  124. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  125. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2030  
  126. 2013-01-16 09:20:48:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720007 with negotiated timeout 20000 for client /127.0.0.1:2030  
  127. 2013-01-16 09:20:48:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720007, negotiated timeout = 20000  
  128. 5125 [main] INFO  backtype.storm.daemon.supervisor - Starting supervisor with id a753e74a-55c8-47b5-b5f8-3e5c957335f8 at host PC2010110311cvt  
  129. 5140 [main] INFO  backtype.storm.daemon.supervisor - Starting Supervisor with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/86c7a04d-fe18-4dba-b751-24507fd794e0", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (4 5 6), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}  
  130. 5156 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  131. 2013-01-16 09:20:49:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@16c1227  
  132. 2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  133. 2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2033  
  134. 2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  135. 2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2033  
  136. 2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720008 with negotiated timeout 20000 for client /127.0.0.1:2033  
  137. 2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720008, negotiated timeout = 20000  
  138. 5171 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none  
  139. 2013-01-16 09:20:49:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b2720008  
  140. 2013-01-16 09:20:49:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b2720008 closed  
  141. 5187 [main] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  142. 2013-01-16 09:20:49:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@1b5eba4  
  143. 2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down  
  144. 2013-01-16 09:20:49:WARN org.apache.zookeeper.server.NIOServerCnxn - EndOfStreamException: Unable to read additional data from client sessionid 0x13c40f1b2720008, likely client has closed socket  
  145. 2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2033 which had sessionid 0x13c40f1b2720008  
  146. 2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  147. 2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2036  
  148. 2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  149. 2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2036  
  150. 2013-01-16 09:20:49:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b2720009 with negotiated timeout 20000 for client /127.0.0.1:2036  
  151. 2013-01-16 09:20:49:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b2720009, negotiated timeout = 20000  
  152. 5234 [main] INFO  backtype.storm.daemon.supervisor - Starting supervisor with id a9368e3d-c540-49c8-b7ef-11327e92f9cd at host PC2010110311cvt  
  153. 2013-01-16 09:20:49:DEBUG com.stormdemo.demo.DemoSpout - declareOutputFields----> 设置输出字段  
  154. 5546 [main] INFO  backtype.storm.daemon.nimbus - Received topology submission for demo with conf {"topology.max.task.parallelism" nil, "topology.acker.executors" 1, "topology.kryo.register" nil, "topology.kryo.decorators" (), "topology.name" "demo", "storm.id" "demo-1-1358299249", "topology.workers" 2, "topology.debug" true, "topology.max.spout.pending" 1}  
  155. 5593 [main] INFO  backtype.storm.daemon.nimbus - Activating demo: demo-1-1358299249  
  156. 5734 [main] INFO  backtype.storm.scheduler.EvenScheduler - Available slots: (["a9368e3d-c540-49c8-b7ef-11327e92f9cd" 4] ["a9368e3d-c540-49c8-b7ef-11327e92f9cd" 5] ["a9368e3d-c540-49c8-b7ef-11327e92f9cd" 6] ["a753e74a-55c8-47b5-b5f8-3e5c957335f8" 1] ["a753e74a-55c8-47b5-b5f8-3e5c957335f8" 2] ["a753e74a-55c8-47b5-b5f8-3e5c957335f8" 3])  
  157. 5765 [main] INFO  backtype.storm.daemon.nimbus - Setting new assignment for topology id demo-1-1358299249: #backtype.storm.daemon.common.Assignment{:master-code-dir "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/905e5ab3-42c8-47ef-9687-322ffe72a619/nimbus/stormdist/demo-1-1358299249", :node->host {"a753e74a-55c8-47b5-b5f8-3e5c957335f8" "PC2010110311cvt", "a9368e3d-c540-49c8-b7ef-11327e92f9cd" "PC2010110311cvt"}, :executor->node+port {[3 3] ["a9368e3d-c540-49c8-b7ef-11327e92f9cd" 4], [2 2] ["a753e74a-55c8-47b5-b5f8-3e5c957335f8" 1], [1 1] ["a9368e3d-c540-49c8-b7ef-11327e92f9cd" 4]}, :executor->start-time-secs {[1 1] 1358299249, [3 3] 1358299249, [2 2] 1358299249}}  
  158. 6109 [Thread-5] INFO  backtype.storm.daemon.supervisor - Downloading code for storm id demo-1-1358299249 from C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\/905e5ab3-42c8-47ef-9687-322ffe72a619/nimbus/stormdist/demo-1-1358299249  
  159. 6328 [Thread-8] INFO  backtype.storm.daemon.supervisor - Downloading code for storm id demo-1-1358299249 from C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\/905e5ab3-42c8-47ef-9687-322ffe72a619/nimbus/stormdist/demo-1-1358299249  
  160. 6578 [Thread-5] INFO  backtype.storm.daemon.supervisor - Finished downloading code for storm id demo-1-1358299249 from C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\/905e5ab3-42c8-47ef-9687-322ffe72a619/nimbus/stormdist/demo-1-1358299249  
  161. 6640 [Thread-6] INFO  backtype.storm.daemon.supervisor - Launching worker with assignment #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id "demo-1-1358299249", :executors [[2 2]]} for this supervisor a753e74a-55c8-47b5-b5f8-3e5c957335f8 on port 1 with id ce797194-f0a1-4d1f-a0df-6a388935cf26  
  162. 6656 [Thread-6] INFO  backtype.storm.daemon.worker - Launching worker for demo-1-1358299249 on a753e74a-55c8-47b5-b5f8-3e5c957335f8:1 with id ce797194-f0a1-4d1f-a0df-6a388935cf26 and conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/dd108ee9-8f33-4324-9ef7-7b3b2f443f23", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1 2 3), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}  
  163. 6656 [Thread-6] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  164. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@a64a92  
  165. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  166. 2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2039  
  167. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  168. 2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2039  
  169. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b272000a, negotiated timeout = 20000  
  170. 2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b272000a with negotiated timeout 20000 for client /127.0.0.1:2039  
  171. 6671 [Thread-6-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none  
  172. 2013-01-16 09:20:50:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b272000a  
  173. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b272000a closed  
  174. 2013-01-16 09:20:50:WARN org.apache.zookeeper.server.NIOServerCnxn - EndOfStreamException: Unable to read additional data from client sessionid 0x13c40f1b272000a, likely client has closed socket  
  175. 2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2039 which had sessionid 0x13c40f1b272000a  
  176. 6687 [Thread-6] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  177. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@1264666  
  178. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down  
  179. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  180. 2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2042  
  181. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  182. 2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2042  
  183. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b272000b, negotiated timeout = 20000  
  184. 2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b272000b with negotiated timeout 20000 for client /127.0.0.1:2042  
  185. 7031 [Thread-8] INFO  backtype.storm.daemon.supervisor - Finished downloading code for storm id demo-1-1358299249 from C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\/905e5ab3-42c8-47ef-9687-322ffe72a619/nimbus/stormdist/demo-1-1358299249  
  186. 7093 [Thread-9] INFO  backtype.storm.daemon.supervisor - Launching worker with assignment #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id "demo-1-1358299249", :executors ([3 3] [1 1])} for this supervisor a9368e3d-c540-49c8-b7ef-11327e92f9cd on port 4 with id b56bca1d-cdd0-458c-941a-7f1719d5bc2b  
  187. 7109 [Thread-9] INFO  backtype.storm.daemon.worker - Launching worker for demo-1-1358299249 on a9368e3d-c540-49c8-b7ef-11327e92f9cd:4 with id b56bca1d-cdd0-458c-941a-7f1719d5bc2b and conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/86c7a04d-fe18-4dba-b751-24507fd794e0", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (4 5 6), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}  
  188. 7109 [Thread-9] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  189. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@b80017  
  190. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  191. 2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2045  
  192. 2013-01-16 09:20:50:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  193. 2013-01-16 09:20:50:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2045  
  194. 2013-01-16 09:20:51:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b272000c with negotiated timeout 20000 for client /127.0.0.1:2045  
  195. 2013-01-16 09:20:51:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b272000c, negotiated timeout = 20000  
  196. 7171 [Thread-9-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none  
  197. 2013-01-16 09:20:51:INFO org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x13c40f1b272000c  
  198. 2013-01-16 09:20:51:INFO org.apache.zookeeper.ZooKeeper - Session: 0x13c40f1b272000c closed  
  199. 2013-01-16 09:20:51:WARN org.apache.zookeeper.server.NIOServerCnxn - EndOfStreamException: Unable to read additional data from client sessionid 0x13c40f1b272000c, likely client has closed socket  
  200. 2013-01-16 09:20:51:INFO org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:2045 which had sessionid 0x13c40f1b272000c  
  201. 7203 [Thread-9] INFO  com.netflix.curator.framework.imps.CuratorFrameworkImpl - Starting  
  202. 2013-01-16 09:20:51:INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@1be3bb2  
  203. 2013-01-16 09:20:51:INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000  
  204. 2013-01-16 09:20:51:INFO org.apache.zookeeper.ClientCnxn - EventThread shut down  
  205. 2013-01-16 09:20:51:INFO org.apache.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session  
  206. 2013-01-16 09:20:51:INFO org.apache.zookeeper.server.NIOServerCnxn - Accepted socket connection from /127.0.0.1:2048  
  207. 2013-01-16 09:20:51:INFO org.apache.zookeeper.server.NIOServerCnxn - Client attempting to establish new session at /127.0.0.1:2048  
  208. 2013-01-16 09:20:51:INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x13c40f1b272000d, negotiated timeout = 20000  
  209. 2013-01-16 09:20:51:INFO org.apache.zookeeper.server.NIOServerCnxn - Established session 0x13c40f1b272000d with negotiated timeout 20000 for client /127.0.0.1:2048  
  210. 7531 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor 2:[2 2]  
  211. 7531 [Thread-9] INFO  backtype.storm.daemon.executor - Loading executor __acker:[3 3]  
  212. 7546 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: 2 __system ["startup"]  
  213. 7546 [Thread-9] INFO  backtype.storm.daemon.task - Emitting: __acker __system ["startup"]  
  214. 7546 [Thread-9] INFO  backtype.storm.daemon.executor - Loaded executor tasks __acker:[3 3]  
  215. 7546 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks 2:[2 2]  
  216. 7562 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor 2:[2 2]  
  217. 7562 [Thread-6] INFO  backtype.storm.daemon.worker - Launching receive-thread for a753e74a-55c8-47b5-b5f8-3e5c957335f8:1  
  218. 7562 [Thread-23] INFO  backtype.storm.daemon.executor - Preparing bolt 2:(2)  
  219. 7562 [Thread-22] INFO  backtype.storm.daemon.executor - Preparing bolt __acker:(3)  
  220. 7562 [Thread-9] INFO  backtype.storm.daemon.executor - Finished loading executor __acker:[3 3]  
  221. 7578 [Thread-23] INFO  backtype.storm.daemon.executor - Prepared bolt 2:(2)  
  222. 7578 [Thread-22] INFO  backtype.storm.daemon.executor - Prepared bolt __acker:(3)  
  223. 7578 [Thread-9] INFO  backtype.storm.daemon.executor - Loading executor 1:[1 1]  
  224. 7593 [Thread-9] INFO  backtype.storm.daemon.task - Emitting: 1 __system ["startup"]  
  225. 7593 [Thread-9] INFO  backtype.storm.daemon.executor - Loaded executor tasks 1:[1 1]  
  226. 7593 [Thread-6] INFO  backtype.storm.daemon.worker - Worker has topology config {"storm.id" "demo-1-1358299249", "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/dd108ee9-8f33-4324-9ef7-7b3b2f443f23", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.kryo.decorators" (), "topology.name" "demo", "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" 1, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1 2 3), "topology.debug" true, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.kryo.register" nil, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 2, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}  
  227. 7593 [Thread-6] INFO  backtype.storm.daemon.worker - Worker ce797194-f0a1-4d1f-a0df-6a388935cf26 for storm demo-1-1358299249 on a753e74a-55c8-47b5-b5f8-3e5c957335f8:1 has finished loading  
  228. 7609 [Thread-9] INFO  backtype.storm.daemon.executor - Finished loading executor 1:[1 1]  
  229. 7609 [Thread-9] INFO  backtype.storm.daemon.worker - Launching receive-thread for a9368e3d-c540-49c8-b7ef-11327e92f9cd:4  
  230. 7609 [Thread-27] INFO  backtype.storm.daemon.executor - Opening spout 1:(1)  
  231. 7609 [Thread-9] INFO  backtype.storm.daemon.worker - Worker has topology config {"storm.id" "demo-1-1358299249", "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\/86c7a04d-fe18-4dba-b751-24507fd794e0", "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" 1, "topology.kryo.decorators" (), "topology.name" "demo", "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "topology.max.spout.pending" 1, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (4 5 6), "topology.debug" true, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.kryo.register" nil, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 2, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.acker.tasks" nil, "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}  
  232. 7609 [Thread-9] INFO  backtype.storm.daemon.worker - Worker b56bca1d-cdd0-458c-941a-7f1719d5bc2b for storm demo-1-1358299249 on a9368e3d-c540-49c8-b7ef-11327e92f9cd:4 has finished loading  
  233. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - spout-----> 将集合数据转换至队列中  
  234. 7609 [Thread-27] INFO  backtype.storm.daemon.executor - Opened spout 1:(1)  
  235. 7609 [Thread-27] INFO  backtype.storm.daemon.executor - Activating spout 1:(1)  
  236. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 发送数据,用户ID=1  
  237. 7609 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=1 name=zhang1 age=21]]  
  238. 7609 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [2694535958820228165 3828879903368972585 1]  
  239. 7609 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [2694535958820228165 3828879903368972585 1]  
  240. 7625 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {2694535958820228165=3828879903368972585}, [[Person id=1 name=zhang1 age=21]]  
  241. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->处理数据  
  242. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 处理数据  用户=[Person id=1 name=zhang1 age=21]  
  243. 7625 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [2694535958820228165 3828879903368972585]  
  244. 7625 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [2694535958820228165, 3828879903368972585]  
  245. 7625 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [2694535958820228165]  
  246. 7625 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [2694535958820228165]  
  247. 7625 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=1 name=zhang1 age=21]  
  248. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=1 name=zhang1 age=21]  
  249. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 发送数据,用户ID=2  
  250. 7625 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=2 name=zhang2 age=22]]  
  251. 7625 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [-5811949556035385002 -6890630316263539517 1]  
  252. 7625 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [-5811949556035385002 -6890630316263539517 1]  
  253. 7625 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {-5811949556035385002=-6890630316263539517}, [[Person id=2 name=zhang2 age=22]]  
  254. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->处理数据  
  255. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 处理数据  用户=[Person id=2 name=zhang2 age=22]  
  256. 7625 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [-5811949556035385002 -6890630316263539517]  
  257. 7625 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [-5811949556035385002, -6890630316263539517]  
  258. 7625 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [-5811949556035385002]  
  259. 7640 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [-5811949556035385002]  
  260. 7640 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=2 name=zhang2 age=22]  
  261. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=2 name=zhang2 age=22]  
  262. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 发送数据,用户ID=3  
  263. 7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=3 name=zhang3 age=23]]  
  264. 7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [219257472962751953 6078625470356348063 1]  
  265. 7640 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [219257472962751953 6078625470356348063 1]  
  266. 7640 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {219257472962751953=6078625470356348063}, [[Person id=3 name=zhang3 age=23]]  
  267. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->处理数据  
  268. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 处理数据  用户=[Person id=3 name=zhang3 age=23]  
  269. 7640 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [219257472962751953 6078625470356348063]  
  270. 7640 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [219257472962751953, 6078625470356348063]  
  271. 7640 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [219257472962751953]  
  272. 7640 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [219257472962751953]  
  273. 7640 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=3 name=zhang3 age=23]  
  274. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=3 name=zhang3 age=23]  
  275. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 发送数据,用户ID=4  
  276. 7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=4 name=zhang4 age=24]]  
  277. 7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [4318562922526141994 8191650156051441196 1]  
  278. 7640 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [4318562922526141994 8191650156051441196 1]  
  279. 7640 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {4318562922526141994=8191650156051441196}, [[Person id=4 name=zhang4 age=24]]  
  280. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->处理数据  
  281. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 处理数据  用户=[Person id=4 name=zhang4 age=24]  
  282. 7640 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [4318562922526141994 8191650156051441196]  
  283. 7640 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [4318562922526141994, 8191650156051441196]  
  284. 7640 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [4318562922526141994]  
  285. 7640 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [4318562922526141994]  
  286. 7640 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=4 name=zhang4 age=24]  
  287. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=4 name=zhang4 age=24]  
  288. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 发送数据,用户ID=5  
  289. 7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=5 name=zhang5 age=25]]  
  290. 7640 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [-5525623119314927399 3663529653696391654 1]  
  291. 7640 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {-5525623119314927399=3663529653696391654}, [[Person id=5 name=zhang5 age=25]]  
  292. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->处理数据  
  293. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 处理数据  用户=[Person id=5 name=zhang5 age=25]  
  294. 7640 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [-5525623119314927399 3663529653696391654 1]  
  295. 7640 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [-5525623119314927399 3663529653696391654]  
  296. 7656 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [-5525623119314927399, 3663529653696391654]  
  297. 7656 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [-5525623119314927399]  
  298. 7656 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [-5525623119314927399]  
  299. 7656 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=5 name=zhang5 age=25]  
  300. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=5 name=zhang5 age=25]  
  301. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 发送数据,用户ID=6  
  302. 7656 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=6 name=zhang6 age=26]]  
  303. 7656 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [4444831176256327809 6692541082140116000 1]  
  304. 7656 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [4444831176256327809 6692541082140116000 1]  
  305. 7656 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {4444831176256327809=6692541082140116000}, [[Person id=6 name=zhang6 age=26]]  
  306. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->处理数据  
  307. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 处理数据  用户=[Person id=6 name=zhang6 age=26]  
  308. 7656 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [4444831176256327809 6692541082140116000]  
  309. 7656 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [4444831176256327809, 6692541082140116000]  
  310. 7656 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [4444831176256327809]  
  311. 7656 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [4444831176256327809]  
  312. 7656 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=6 name=zhang6 age=26]  
  313. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=6 name=zhang6 age=26]  
  314. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 发送数据,用户ID=7  
  315. 7656 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=7 name=zhang7 age=27]]  
  316. 7656 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [6115911456780872788 1675690715082104323 1]  
  317. 7656 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [6115911456780872788 1675690715082104323 1]  
  318. 7656 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {6115911456780872788=1675690715082104323}, [[Person id=7 name=zhang7 age=27]]  
  319. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->处理数据  
  320. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 处理数据  用户=[Person id=7 name=zhang7 age=27]  
  321. 7656 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [6115911456780872788 1675690715082104323]  
  322. 7656 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [6115911456780872788, 1675690715082104323]  
  323. 7656 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [6115911456780872788]  
  324. 7671 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [6115911456780872788]  
  325. 7671 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=7 name=zhang7 age=27]  
  326. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=7 name=zhang7 age=27]  
  327. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 发送数据,用户ID=8  
  328. 7671 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=8 name=zhang8 age=28]]  
  329. 7671 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [8569256651305376437 5838382650884274902 1]  
  330. 7671 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [8569256651305376437 5838382650884274902 1]  
  331. 7671 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {8569256651305376437=5838382650884274902}, [[Person id=8 name=zhang8 age=28]]  
  332. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->处理数据  
  333. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 处理数据  用户=[Person id=8 name=zhang8 age=28]  
  334. 7671 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [8569256651305376437 5838382650884274902]  
  335. 7671 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [8569256651305376437, 5838382650884274902]  
  336. 7671 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [8569256651305376437]  
  337. 7671 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [8569256651305376437]  
  338. 7671 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=8 name=zhang8 age=28]  
  339. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=8 name=zhang8 age=28]  
  340. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - nextTuple----> 发送数据,用户ID=9  
  341. 7671 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 default [[Person id=9 name=zhang9 age=29]]  
  342. 7671 [Thread-27] INFO  backtype.storm.daemon.task - Emitting: 1 __ack_init [4632521528974275102 -5861573244111071873 1]  
  343. 7671 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: __ack_init, id: {}, [4632521528974275102 -5861573244111071873 1]  
  344. 7671 [Thread-23] INFO  backtype.storm.daemon.executor - Processing received message source: 1:1, stream: default, id: {4632521528974275102=-5861573244111071873}, [[Person id=9 name=zhang9 age=29]]  
  345. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - execute----->处理数据  
  346. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.ListBolt - 处理数据  用户=[Person id=9 name=zhang9 age=29]  
  347. 7671 [Thread-23] INFO  backtype.storm.daemon.task - Emitting: 2 __ack_ack [4632521528974275102 -5861573244111071873]  
  348. 7671 [Thread-22] INFO  backtype.storm.daemon.executor - Processing received message source: 2:2, stream: __ack_ack, id: {}, [4632521528974275102, -5861573244111071873]  
  349. 7671 [Thread-22] INFO  backtype.storm.daemon.task - Emitting direct: 1; __acker __ack_ack [4632521528974275102]  
  350. 7671 [Thread-27] INFO  backtype.storm.daemon.executor - Processing received message source: __acker:3, stream: __ack_ack, id: {}, [4632521528974275102]  
  351. 7671 [Thread-27] INFO  backtype.storm.daemon.executor - Acking message [Person id=9 name=zhang9 age=29]  
  352. 2013-01-16 09:20:51:DEBUG com.stormdemo.demo.DemoSpout - ack-----> [Person id=9 name=zhang9 age=29]  
  353. 2013-01-16 09:21:19:DEBUG com.stormdemo.demo.DemoTopology - stormdemo结束  
  354. 2013-01-16 09:21:19:DEBUG com.stormdemo.demo.DemoTopology - 共消耗时间:运行=7109,总时间:37109  



  • 0
    点赞
  • 5
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值