WordCountTopology 执行日志分析

最新推荐文章于 2019-09-26 12:29:11 发布
最新推荐文章于 2019-09-26 12:29:11 发布
阅读量2.3k 收藏
点赞数
分类专栏： cloud
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/joeyon1985/article/details/42918433
版权

1，代码

package storm.starter;

import backtype.storm.Config;
import backtype.storm.LocalCluster;
import backtype.storm.StormSubmitter;
import backtype.storm.task.ShellBolt;
import backtype.storm.topology.BasicOutputCollector;
import backtype.storm.topology.IRichBolt;
import backtype.storm.topology.OutputFieldsDeclarer;
import backtype.storm.topology.TopologyBuilder;
import backtype.storm.topology.base.BaseBasicBolt;
import backtype.storm.tuple.Fields;
import backtype.storm.tuple.Tuple;
import backtype.storm.tuple.Values;
import storm.starter.spout.RandomSentenceSpout;

import java.util.HashMap;
import java.util.Map;

/**
 * This topology demonstrates Storm's stream groupings and multilang capabilities.
 */
public class WordCountTopology {
  public static class SplitSentence extends ShellBolt implements IRichBolt {

    public SplitSentence() {
      super("python", "splitsentence.py");
    }

    @Override
    public void declareOutputFields(OutputFieldsDeclarer declarer) {
      declarer.declare(new Fields("word"));
    }

    @Override
    public Map<String, Object> getComponentConfiguration() {
      return null;
    }
  }

  public static class WordCount extends BaseBasicBolt {
    Map<String, Integer> counts = new HashMap<String, Integer>();

    @Override
    public void execute(Tuple tuple, BasicOutputCollector collector) {
      String word = tuple.getString(0);
      
      System.out.println(this + "====" + word);  
      
      
      Integer count = counts.get(word);
      if (count == null)
        count = 0;
      count++;
      counts.put(word, count);
      collector.emit(new Values(word, count));
    }

    @Override
    public void declareOutputFields(OutputFieldsDeclarer declarer) {
      declarer.declare(new Fields("word", "count"));
    }
  }

  public static void main(String[] args) throws Exception {

    TopologyBuilder builder = new TopologyBuilder();

    builder.setSpout("spout", new RandomSentenceSpout(), 5);

    builder.setBolt("split", new SplitSentence(), 8).shuffleGrouping("spout");
    builder.setBolt("count", new WordCount(), 12).fieldsGrouping("split", new Fields("word"));

    Config conf = new Config();
    conf.setDebug(true);


    if (args != null && args.length > 0) {
      conf.setNumWorkers(3);

      StormSubmitter.submitTopology(args[0], conf, builder.createTopology());
    }
    else {
      conf.setMaxTaskParallelism(3);

      LocalCluster cluster = new LocalCluster();
      cluster.submitTopology("word-count", conf, builder.createTopology());

      Thread.sleep(10000);

      cluster.shutdown();
    }
  }
}



2,执行日志

1844 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
1844 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:host.name=shijiangyong
1844 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:java.version=1.7.0_15
1844 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
1844 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:java.home=D:\soft\eclipse-jee-indigo-SR2-win32\eclipse\jre
1844 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:java.class.path=E:\storm\target\classes;D:\soft\apache-storm-0.9.3\lib\tools.macro-0.1.0.jar;D:\soft\apache-storm-0.9.3\lib\asm-4.0.jar;D:\soft\apache-storm-0.9.3\lib\carbonite-1.4.0.jar;D:\soft\apache-storm-0.9.3\lib\chill-java-0.3.5.jar;D:\soft\apache-storm-0.9.3\lib\clj-stacktrace-0.2.2.jar;D:\soft\apache-storm-0.9.3\lib\clj-time-0.4.1.jar;D:\soft\apache-storm-0.9.3\lib\clojure-1.5.1.jar;D:\soft\apache-storm-0.9.3\lib\clout-1.0.1.jar;D:\soft\apache-storm-0.9.3\lib\commons-codec-1.6.jar;D:\soft\apache-storm-0.9.3\lib\commons-exec-1.1.jar;D:\soft\apache-storm-0.9.3\lib\commons-fileupload-1.2.1.jar;D:\soft\apache-storm-0.9.3\lib\commons-io-2.4.jar;D:\soft\apache-storm-0.9.3\lib\commons-lang-2.5.jar;D:\soft\apache-storm-0.9.3\lib\commons-logging-1.1.3.jar;D:\soft\apache-storm-0.9.3\lib\compojure-1.1.3.jar;D:\soft\apache-storm-0.9.3\lib\core.incubator-0.1.0.jar;D:\soft\apache-storm-0.9.3\lib\disruptor-2.10.1.jar;D:\soft\apache-storm-0.9.3\lib\hiccup-0.3.6.jar;D:\soft\apache-storm-0.9.3\lib\jetty-6.1.26.jar;D:\soft\apache-storm-0.9.3\lib\jetty-util-6.1.26.jar;D:\soft\apache-storm-0.9.3\lib\jgrapht-core-0.9.0.jar;D:\soft\apache-storm-0.9.3\lib\jline-2.11.jar;D:\soft\apache-storm-0.9.3\lib\joda-time-2.0.jar;D:\soft\apache-storm-0.9.3\lib\json-simple-1.1.jar;D:\soft\apache-storm-0.9.3\lib\kryo-2.21.jar;D:\soft\apache-storm-0.9.3\lib\log4j-over-slf4j-1.6.6.jar;D:\soft\apache-storm-0.9.3\lib\logback-classic-1.0.13.jar;D:\soft\apache-storm-0.9.3\lib\logback-core-1.0.13.jar;D:\soft\apache-storm-0.9.3\lib\math.numeric-tower-0.0.1.jar;D:\soft\apache-storm-0.9.3\lib\minlog-1.2.jar;D:\soft\apache-storm-0.9.3\lib\objenesis-1.2.jar;D:\soft\apache-storm-0.9.3\lib\reflectasm-1.07-shaded.jar;D:\soft\apache-storm-0.9.3\lib\ring-core-1.1.5.jar;D:\soft\apache-storm-0.9.3\lib\ring-devel-0.3.11.jar;D:\soft\apache-storm-0.9.3\lib\ring-jetty-adapter-0.3.11.jar;D:\soft\apache-storm-0.9.3\lib\ring-servlet-0.3.11.jar;D:\soft\apache-storm-0.9.3\lib\servlet-api-2.5.jar;D:\soft\apache-storm-0.9.3\lib\slf4j-api-1.7.5.jar;D:\soft\apache-storm-0.9.3\lib\snakeyaml-1.11.jar;D:\soft\apache-storm-0.9.3\lib\storm-core-0.9.3.jar;D:\soft\apache-storm-0.9.3\lib\tools.cli-0.2.4.jar;D:\soft\apache-storm-0.9.3\lib\tools.logging-0.2.3.jar;D:\资料\ZQGAMEAPI\1 源代码\1.1 系统代码\zqgame-phonemessage-query\WebRoot\WEB-INF\lib\commons-collections-3.1.jar;E:\Program\apache-maven-3.2.1\lib\guava-14.0.1.jar;D:\Personal Data\.m2\commons-collections\commons-collections\3.2.1\commons-collections-3.2.1.jar;D:\Personal Data\.m2\com\google\guava\guava\15.0\guava-15.0.jar
1844 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:java.library.path=D:\soft\eclipse-jee-indigo-SR2-win32\eclipse\jre\bin;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;D:/soft/eclipse-jee-indigo-SR2-win32/eclipse/jre/bin/client;D:/soft/eclipse-jee-indigo-SR2-win32/eclipse/jre/bin;D:/soft/eclipse-jee-indigo-SR2-win32/eclipse/jre/lib/i386;E:\oracle\product\10.2.0\client_1\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Files\TortoiseSVN\bin;E:\Program\apache-maven-3.2.1\bin;D:\soft\apache-ant-1.9.4-bin\apache-ant-1.9.4\bin;D:\soft\gradle-1.12-bin\bin;C:\Program Files\TortoiseGit\bin;C:\Program Files\nodejs\;C:\Program Files\erl6.1\bin;C:\MinGW\bin;C:\Program Files\MySQL\MySQL Server 5.5\bin;C:\jdk1.7.0_15/bin;D:\DOCUME~1\ADMINI~1\Local Settings\Application Data\Kingsoft\WPS Office\9.1.0.4885\office6;C:\Program Files\OpenVPN\bin;C:\Documents and Settings\Administrator\Application Data\npm;C:\Program Files\nodejs\node_global\;C:\Python27;C:\Python27\Scripts;C:\jdk1.7.0_15\bin;D:\soft\apache-storm-0.9.3\bin;;D:\soft\eclipse-jee-indigo-SR2-win32\eclipse;;.
1860 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\
1860 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
1860 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:os.name=Windows XP
1860 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:os.arch=x86
1860 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:os.version=5.1
1860 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:user.name=Administrator
1860 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:user.home=d:\Personal Data
1860 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Client environment:user.dir=E:\storm
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:host.name=shijiangyong
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:java.version=1.7.0_15
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:java.vendor=Oracle Corporation
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:java.home=D:\soft\eclipse-jee-indigo-SR2-win32\eclipse\jre
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:java.class.path=E:\storm\target\classes;D:\soft\apache-storm-0.9.3\lib\tools.macro-0.1.0.jar;D:\soft\apache-storm-0.9.3\lib\asm-4.0.jar;D:\soft\apache-storm-0.9.3\lib\carbonite-1.4.0.jar;D:\soft\apache-storm-0.9.3\lib\chill-java-0.3.5.jar;D:\soft\apache-storm-0.9.3\lib\clj-stacktrace-0.2.2.jar;D:\soft\apache-storm-0.9.3\lib\clj-time-0.4.1.jar;D:\soft\apache-storm-0.9.3\lib\clojure-1.5.1.jar;D:\soft\apache-storm-0.9.3\lib\clout-1.0.1.jar;D:\soft\apache-storm-0.9.3\lib\commons-codec-1.6.jar;D:\soft\apache-storm-0.9.3\lib\commons-exec-1.1.jar;D:\soft\apache-storm-0.9.3\lib\commons-fileupload-1.2.1.jar;D:\soft\apache-storm-0.9.3\lib\commons-io-2.4.jar;D:\soft\apache-storm-0.9.3\lib\commons-lang-2.5.jar;D:\soft\apache-storm-0.9.3\lib\commons-logging-1.1.3.jar;D:\soft\apache-storm-0.9.3\lib\compojure-1.1.3.jar;D:\soft\apache-storm-0.9.3\lib\core.incubator-0.1.0.jar;D:\soft\apache-storm-0.9.3\lib\disruptor-2.10.1.jar;D:\soft\apache-storm-0.9.3\lib\hiccup-0.3.6.jar;D:\soft\apache-storm-0.9.3\lib\jetty-6.1.26.jar;D:\soft\apache-storm-0.9.3\lib\jetty-util-6.1.26.jar;D:\soft\apache-storm-0.9.3\lib\jgrapht-core-0.9.0.jar;D:\soft\apache-storm-0.9.3\lib\jline-2.11.jar;D:\soft\apache-storm-0.9.3\lib\joda-time-2.0.jar;D:\soft\apache-storm-0.9.3\lib\json-simple-1.1.jar;D:\soft\apache-storm-0.9.3\lib\kryo-2.21.jar;D:\soft\apache-storm-0.9.3\lib\log4j-over-slf4j-1.6.6.jar;D:\soft\apache-storm-0.9.3\lib\logback-classic-1.0.13.jar;D:\soft\apache-storm-0.9.3\lib\logback-core-1.0.13.jar;D:\soft\apache-storm-0.9.3\lib\math.numeric-tower-0.0.1.jar;D:\soft\apache-storm-0.9.3\lib\minlog-1.2.jar;D:\soft\apache-storm-0.9.3\lib\objenesis-1.2.jar;D:\soft\apache-storm-0.9.3\lib\reflectasm-1.07-shaded.jar;D:\soft\apache-storm-0.9.3\lib\ring-core-1.1.5.jar;D:\soft\apache-storm-0.9.3\lib\ring-devel-0.3.11.jar;D:\soft\apache-storm-0.9.3\lib\ring-jetty-adapter-0.3.11.jar;D:\soft\apache-storm-0.9.3\lib\ring-servlet-0.3.11.jar;D:\soft\apache-storm-0.9.3\lib\servlet-api-2.5.jar;D:\soft\apache-storm-0.9.3\lib\slf4j-api-1.7.5.jar;D:\soft\apache-storm-0.9.3\lib\snakeyaml-1.11.jar;D:\soft\apache-storm-0.9.3\lib\storm-core-0.9.3.jar;D:\soft\apache-storm-0.9.3\lib\tools.cli-0.2.4.jar;D:\soft\apache-storm-0.9.3\lib\tools.logging-0.2.3.jar;D:\资料\ZQGAMEAPI\1 源代码\1.1 系统代码\zqgame-phonemessage-query\WebRoot\WEB-INF\lib\commons-collections-3.1.jar;E:\Program\apache-maven-3.2.1\lib\guava-14.0.1.jar;D:\Personal Data\.m2\commons-collections\commons-collections\3.2.1\commons-collections-3.2.1.jar;D:\Personal Data\.m2\com\google\guava\guava\15.0\guava-15.0.jar
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:java.library.path=D:\soft\eclipse-jee-indigo-SR2-win32\eclipse\jre\bin;C:\WINDOWS\Sun\Java\bin;C:\WINDOWS\system32;C:\WINDOWS;D:/soft/eclipse-jee-indigo-SR2-win32/eclipse/jre/bin/client;D:/soft/eclipse-jee-indigo-SR2-win32/eclipse/jre/bin;D:/soft/eclipse-jee-indigo-SR2-win32/eclipse/jre/lib/i386;E:\oracle\product\10.2.0\client_1\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Files\TortoiseSVN\bin;E:\Program\apache-maven-3.2.1\bin;D:\soft\apache-ant-1.9.4-bin\apache-ant-1.9.4\bin;D:\soft\gradle-1.12-bin\bin;C:\Program Files\TortoiseGit\bin;C:\Program Files\nodejs\;C:\Program Files\erl6.1\bin;C:\MinGW\bin;C:\Program Files\MySQL\MySQL Server 5.5\bin;C:\jdk1.7.0_15/bin;D:\DOCUME~1\ADMINI~1\Local Settings\Application Data\Kingsoft\WPS Office\9.1.0.4885\office6;C:\Program Files\OpenVPN\bin;C:\Documents and Settings\Administrator\Application Data\npm;C:\Program Files\nodejs\node_global\;C:\Python27;C:\Python27\Scripts;C:\jdk1.7.0_15\bin;D:\soft\apache-storm-0.9.3\bin;;D:\soft\eclipse-jee-indigo-SR2-win32\eclipse;;.
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:java.io.tmpdir=C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:java.compiler=<NA>
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:os.name=Windows XP
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:os.arch=x86
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:os.version=5.1
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:user.name=Administrator
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:user.home=d:\Personal Data
1875 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Server environment:user.dir=E:\storm
2360 [main] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\9d185569-0a02-4248-83be-5730b17c62a0\version-2 snapdir C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\9d185569-0a02-4248-83be-5730b17c62a0\version-2
2360 [main] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - binding to port 0.0.0.0/0.0.0.0:2000
2360 [main] INFO  backtype.storm.zookeeper - Starting inprocess zookeeper at port 2000 and dir C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\9d185569-0a02-4248-83be-5730b17c62a0
2453 [main] INFO  backtype.storm.daemon.nimbus - Starting Nimbus with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "storm.messaging.netty.flush.check.interval.ms" 10, "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m", "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\f7d1e919-dbfd-47f0-af0d-135de2b1da46", "storm.messaging.netty.buffer_size" 5242880, "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "storm.meta.serialization.delegate" "backtype.storm.serialization.DefaultSerializationDelegate", "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000, "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" nil, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m", "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 300, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" [6700 6701 6702 6703], "topology.environment" nil, "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.worker.receiver.thread.count" 1, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.max.task.parallelism" nil, "storm.messaging.netty.transfer.batch.size" 262144, "topology.classpath" nil}
2453 [main] INFO  backtype.storm.daemon.nimbus - Using default scheduler
2453 [main] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
2516 [main] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
2516 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@1e10aef
2531 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
2531 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
2531 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1369
2531 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1369
2531 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.persistence.FileTxnLog - Creating new log file: log.1
2563 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca0000 with negotiated timeout 20000 for client /127.0.0.1:1369
2563 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca0000, negotiated timeout = 20000
2563 [main-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2578 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
4063 [ProcessThread(sid:0 cport:-1):] INFO  org.apache.storm.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14b063cbaca0000
4094 [main-EventThread] INFO  org.apache.storm.zookeeper.ClientCnxn - EventThread shut down
4094 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Session: 0x14b063cbaca0000 closed
4094 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:1369 which had sessionid 0x14b063cbaca0000
4094 [main] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
4094 [main] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
4094 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@864dce
4094 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
4094 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
4094 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1374
4094 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1374
4110 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca0001 with negotiated timeout 20000 for client /127.0.0.1:1374
4110 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca0001, negotiated timeout = 20000
4110 [main-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
4219 [main] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
4219 [main] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
4219 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@e9e162
4235 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
4235 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
4235 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1377
4235 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1377
4250 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca0002 with negotiated timeout 20000 for client /127.0.0.1:1377
4250 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca0002, negotiated timeout = 20000
4250 [main-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
4250 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
4250 [ProcessThread(sid:0 cport:-1):] INFO  org.apache.storm.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14b063cbaca0002
4266 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Session: 0x14b063cbaca0002 closed
4266 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:1377 which had sessionid 0x14b063cbaca0002
4266 [main-EventThread] INFO  org.apache.storm.zookeeper.ClientCnxn - EventThread shut down
4266 [main] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
4266 [main] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
4266 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@a05094
4266 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
4266 [main] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
4266 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
4266 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1380
4266 [main] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
4266 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1380
4266 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@1d1dca4
4266 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
4266 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
4266 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1383
4266 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1383
4297 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca0003 with negotiated timeout 20000 for client /127.0.0.1:1380
4297 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca0003, negotiated timeout = 20000
4297 [main-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
4313 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca0004 with negotiated timeout 20000 for client /127.0.0.1:1383
4313 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca0004, negotiated timeout = 20000
4313 [main-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
4313 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
4313 [ProcessThread(sid:0 cport:-1):] INFO  org.apache.storm.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14b063cbaca0004
4328 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Session: 0x14b063cbaca0004 closed
4328 [main-EventThread] INFO  org.apache.storm.zookeeper.ClientCnxn - EventThread shut down
4328 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:1383 which had sessionid 0x14b063cbaca0004
4328 [main] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
4328 [main] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
4328 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@1405873
4328 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
4328 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1386
4328 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
4328 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1386
4344 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca0005 with negotiated timeout 20000 for client /127.0.0.1:1386
4344 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca0005, negotiated timeout = 20000
4344 [main-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
4360 [main] INFO  backtype.storm.daemon.supervisor - Starting Supervisor with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "storm.messaging.netty.flush.check.interval.ms" 10, "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m", "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\2a16dd07-7b8e-4d7c-ac88-04d26d866001", "storm.messaging.netty.buffer_size" 5242880, "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "storm.meta.serialization.delegate" "backtype.storm.serialization.DefaultSerializationDelegate", "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000, "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" nil, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m", "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 300, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1024 1025 1026), "topology.environment" nil, "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.worker.receiver.thread.count" 1, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.max.task.parallelism" nil, "storm.messaging.netty.transfer.batch.size" 262144, "topology.classpath" nil}
4360 [main] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
4360 [main] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
4360 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@1688eb5
4375 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
4375 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
4375 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1389
4375 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1389
4391 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca0006 with negotiated timeout 20000 for client /127.0.0.1:1389
4391 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca0006, negotiated timeout = 20000
4391 [main-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
4391 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
4391 [ProcessThread(sid:0 cport:-1):] INFO  org.apache.storm.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14b063cbaca0006
4406 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Session: 0x14b063cbaca0006 closed
4406 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:1389 which had sessionid 0x14b063cbaca0006
4406 [main-EventThread] INFO  org.apache.storm.zookeeper.ClientCnxn - EventThread shut down
4406 [main] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
4406 [main] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
4406 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@ba2453
4406 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
4406 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
4406 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1392
4406 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1392
4422 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca0007 with negotiated timeout 20000 for client /127.0.0.1:1392
4422 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca0007, negotiated timeout = 20000
4438 [main-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
4453 [main] INFO  backtype.storm.daemon.supervisor - Starting supervisor with id 350e6c42-5223-4d66-973d-c1f4b06768ec at host shijiangyong
4469 [main] INFO  backtype.storm.daemon.supervisor - Starting Supervisor with conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "storm.messaging.netty.flush.check.interval.ms" 10, "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m", "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\1405666e-4cf4-4d0d-9f34-046c64c47828", "storm.messaging.netty.buffer_size" 5242880, "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "storm.meta.serialization.delegate" "backtype.storm.serialization.DefaultSerializationDelegate", "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000, "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" nil, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m", "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 300, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1027 1028 1029), "topology.environment" nil, "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.worker.receiver.thread.count" 1, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.max.task.parallelism" nil, "storm.messaging.netty.transfer.batch.size" 262144, "topology.classpath" nil}
4469 [main] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
4469 [main] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
4469 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@1a86651
4469 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
4469 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
4469 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1395
4469 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1395
4485 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca0008 with negotiated timeout 20000 for client /127.0.0.1:1395
4485 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca0008, negotiated timeout = 20000
4485 [main-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
4485 [main-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
4485 [ProcessThread(sid:0 cport:-1):] INFO  org.apache.storm.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14b063cbaca0008
4516 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:1395 which had sessionid 0x14b063cbaca0008
4516 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Session: 0x14b063cbaca0008 closed
4516 [main] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
4516 [main] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
4516 [main-EventThread] INFO  org.apache.storm.zookeeper.ClientCnxn - EventThread shut down
4516 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@53022e
4516 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
4516 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
4516 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1398
4516 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1398
4531 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca0009 with negotiated timeout 20000 for client /127.0.0.1:1398
4531 [main-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca0009, negotiated timeout = 20000
4531 [main-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
4547 [main] INFO  backtype.storm.daemon.supervisor - Starting supervisor with id d0369c1e-3793-417a-8f7f-41cff14105a6 at host shijiangyong
4594 [main] INFO  backtype.storm.daemon.nimbus - Received topology submission for word-count with conf {"topology.acker.executors" nil, "topology.kryo.register" nil, "topology.kryo.decorators" (), "topology.name" "word-count", "storm.id" "word-count-1-1421738820", "topology.max.task.parallelism" 3, "topology.debug" true}
4625 [main] INFO  backtype.storm.daemon.nimbus - Activating word-count: word-count-1-1421738820
4703 [main] INFO  backtype.storm.scheduler.EvenScheduler - Available slots: (["d0369c1e-3793-417a-8f7f-41cff14105a6" 1027] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1028] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1029] ["350e6c42-5223-4d66-973d-c1f4b06768ec" 1024] ["350e6c42-5223-4d66-973d-c1f4b06768ec" 1025] ["350e6c42-5223-4d66-973d-c1f4b06768ec" 1026])
4719 [main] INFO  backtype.storm.daemon.nimbus - Setting new assignment for topology id word-count-1-1421738820: #backtype.storm.daemon.common.Assignment{:master-code-dir "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\f7d1e919-dbfd-47f0-af0d-135de2b1da46\\nimbus\\stormdist\\word-count-1-1421738820", :node->host {"d0369c1e-3793-417a-8f7f-41cff14105a6" "shijiangyong"}, :executor->node+port {[2 2] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1027], [3 3] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1027], [4 4] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1027], [5 5] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1027], [6 6] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1027], [7 7] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1027], [8 8] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1027], [9 9] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1027], [10 10] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1027], [1 1] ["d0369c1e-3793-417a-8f7f-41cff14105a6" 1027]}, :executor->start-time-secs {[2 2] 1421738820, [3 3] 1421738820, [4 4] 1421738820, [5 5] 1421738820, [6 6] 1421738820, [7 7] 1421738820, [8 8] 1421738820, [9 9] 1421738820, [10 10] 1421738820, [1 1] 1421738820}}
5500 [Thread-5] INFO  backtype.storm.daemon.supervisor - Downloading code for storm id word-count-1-1421738820 from C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\f7d1e919-dbfd-47f0-af0d-135de2b1da46\nimbus\stormdist\word-count-1-1421738820
5750 [Thread-5] INFO  backtype.storm.daemon.supervisor - Copying resources at file:/E:/storm/target/classes/resources to C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\1405666e-4cf4-4d0d-9f34-046c64c47828\supervisor\stormdist\word-count-1-1421738820\resources
5750 [Thread-5] INFO  backtype.storm.daemon.supervisor - Finished downloading code for storm id word-count-1-1421738820 from C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\f7d1e919-dbfd-47f0-af0d-135de2b1da46\nimbus\stormdist\word-count-1-1421738820
5766 [Thread-6] INFO  backtype.storm.daemon.supervisor - Launching worker with assignment #backtype.storm.daemon.supervisor.LocalAssignment{:storm-id "word-count-1-1421738820", :executors ([2 2] [3 3] [4 4] [5 5] [6 6] [7 7] [8 8] [9 9] [10 10] [1 1])} for this supervisor d0369c1e-3793-417a-8f7f-41cff14105a6 on port 1027 with id 59bac6b4-abad-487f-9d25-4ff73cfee414
5781 [Thread-6] INFO  backtype.storm.daemon.worker - Launching worker for word-count-1-1421738820 on d0369c1e-3793-417a-8f7f-41cff14105a6:1027 with id 59bac6b4-abad-487f-9d25-4ff73cfee414 and conf {"dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "storm.messaging.netty.flush.check.interval.ms" 10, "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m", "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\1405666e-4cf4-4d0d-9f34-046c64c47828", "storm.messaging.netty.buffer_size" 5242880, "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "storm.meta.serialization.delegate" "backtype.storm.serialization.DefaultSerializationDelegate", "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000, "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" nil, "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m", "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 300, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1027 1028 1029), "topology.environment" nil, "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.worker.receiver.thread.count" 1, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.max.task.parallelism" nil, "storm.messaging.netty.transfer.batch.size" 262144, "topology.classpath" nil}
5781 [Thread-6] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
5781 [Thread-6] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
5781 [Thread-6] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@53c1d4
5781 [Thread-6-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
5781 [Thread-6-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
5781 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1403
5781 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1403
5797 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca000a with negotiated timeout 20000 for client /127.0.0.1:1403
5797 [Thread-6-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca000a, negotiated timeout = 20000
5797 [Thread-6-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
5797 [Thread-6-EventThread] INFO  backtype.storm.zookeeper - Zookeeper state update: :connected:none
5797 [ProcessThread(sid:0 cport:-1):] INFO  org.apache.storm.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14b063cbaca000a
5828 [Thread-6-EventThread] INFO  org.apache.storm.zookeeper.ClientCnxn - EventThread shut down
5828 [Thread-6] INFO  org.apache.storm.zookeeper.ZooKeeper - Session: 0x14b063cbaca000a closed
5828 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:1403 which had sessionid 0x14b063cbaca000a
5828 [Thread-6] INFO  backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
5828 [Thread-6] INFO  org.apache.storm.curator.framework.imps.CuratorFrameworkImpl - Starting
5828 [Thread-6] INFO  org.apache.storm.zookeeper.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@156b4b
5828 [Thread-6-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error)
5828 [Thread-6-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session
5828 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:1406
5828 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:1406
5844 [SyncThread:0] INFO  org.apache.storm.zookeeper.server.ZooKeeperServer - Established session 0x14b063cbaca000b with negotiated timeout 20000 for client /127.0.0.1:1406
5844 [Thread-6-SendThread(localhost:2000)] INFO  org.apache.storm.zookeeper.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x14b063cbaca000b, negotiated timeout = 20000
5844 [Thread-6-EventThread] INFO  org.apache.storm.curator.framework.state.ConnectionStateManager - State change: CONNECTED
5844 [Thread-6] INFO  backtype.storm.daemon.worker - Reading Assignments.
6063 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor count:[2 2]
6078 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: count __system ["startup"]
6078 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks count:[2 2]
6078 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor count:[2 2]
6078 [Thread-8-count] INFO  backtype.storm.daemon.executor - Preparing bolt count:(2)
6078 [Thread-8-count] INFO  backtype.storm.daemon.executor - Prepared bolt count:(2)
6078 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor count:[3 3]
6078 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: count __system ["startup"]
6078 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks count:[3 3]
6078 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor count:[3 3]
6094 [Thread-10-count] INFO  backtype.storm.daemon.executor - Preparing bolt count:(3)
6094 [Thread-10-count] INFO  backtype.storm.daemon.executor - Prepared bolt count:(3)
6094 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor count:[4 4]
6094 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: count __system ["startup"]
6094 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks count:[4 4]
6094 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor count:[4 4]
6094 [Thread-12-count] INFO  backtype.storm.daemon.executor - Preparing bolt count:(4)
6094 [Thread-12-count] INFO  backtype.storm.daemon.executor - Prepared bolt count:(4)
6094 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor split:[5 5]
6094 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: split __system ["startup"]
6094 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks split:[5 5]
6110 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor split:[5 5]
6110 [Thread-14-split] INFO  backtype.storm.daemon.executor - Preparing bolt split:(5)
6110 [Thread-14-split] INFO  backtype.storm.utils.ShellProcess - Storm multilang serializer: backtype.storm.multilang.JsonSerializer
6110 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor split:[6 6]
6110 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: split __system ["startup"]
6110 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks split:[6 6]
6110 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor split:[6 6]
6110 [Thread-16-split] INFO  backtype.storm.daemon.executor - Preparing bolt split:(6)
6110 [Thread-16-split] INFO  backtype.storm.utils.ShellProcess - Storm multilang serializer: backtype.storm.multilang.JsonSerializer
6110 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor split:[7 7]
6125 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: split __system ["startup"]
6125 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks split:[7 7]
6125 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor split:[7 7]
6125 [Thread-18-split] INFO  backtype.storm.daemon.executor - Preparing bolt split:(7)
6125 [Thread-18-split] INFO  backtype.storm.utils.ShellProcess - Storm multilang serializer: backtype.storm.multilang.JsonSerializer
6125 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor spout:[8 8]
6125 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: spout __system ["startup"]
6125 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks spout:[8 8]
6141 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor spout:[8 8]
6141 [Thread-20-spout] INFO  backtype.storm.daemon.executor - Opening spout spout:(8)
6141 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor spout:[9 9]
6141 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: spout __system ["startup"]
6141 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks spout:[9 9]
6141 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor spout:[9 9]
6141 [Thread-22-spout] INFO  backtype.storm.daemon.executor - Opening spout spout:(9)
6156 [Thread-20-spout] INFO  backtype.storm.daemon.executor - Opened spout spout:(8)
6156 [Thread-22-spout] INFO  backtype.storm.daemon.executor - Opened spout spout:(9)
6156 [Thread-22-spout] INFO  backtype.storm.daemon.executor - Activating spout spout:(9)
6156 [Thread-20-spout] INFO  backtype.storm.daemon.executor - Activating spout spout:(8)
6156 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor spout:[10 10]
6156 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: spout __system ["startup"]
6156 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks spout:[10 10]
6156 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor spout:[10 10]
6156 [Thread-24-spout] INFO  backtype.storm.daemon.executor - Opening spout spout:(10)
6156 [Thread-24-spout] INFO  backtype.storm.daemon.executor - Opened spout spout:(10)
6156 [Thread-24-spout] INFO  backtype.storm.daemon.executor - Activating spout spout:(10)
6156 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor __system:[-1 -1]
6172 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: __system __system ["startup"]
6172 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks __system:[-1 -1]
6172 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor __system:[-1 -1]
6172 [Thread-26-__system] INFO  backtype.storm.daemon.executor - Preparing bolt __system:(-1)
6172 [Thread-26-__system] INFO  backtype.storm.daemon.executor - Prepared bolt __system:(-1)
6172 [Thread-6] INFO  backtype.storm.daemon.executor - Loading executor __acker:[1 1]
6172 [Thread-6] INFO  backtype.storm.daemon.task - Emitting: __acker __system ["startup"]
6172 [Thread-6] INFO  backtype.storm.daemon.executor - Loaded executor tasks __acker:[1 1]
6188 [Thread-6] INFO  backtype.storm.daemon.executor - Timeouts disabled for executor __acker:[1 1]
6188 [Thread-6] INFO  backtype.storm.daemon.executor - Finished loading executor __acker:[1 1]
6188 [Thread-6] INFO  backtype.storm.daemon.worker - Launching receive-thread for d0369c1e-3793-417a-8f7f-41cff14105a6:1027
6188 [Thread-28-__acker] INFO  backtype.storm.daemon.executor - Preparing bolt __acker:(1)
6188 [Thread-28-__acker] INFO  backtype.storm.daemon.executor - Prepared bolt __acker:(1)
6188 [Thread-29-worker-receiver-thread-0] INFO  backtype.storm.messaging.loader - Starting receive-thread: [stormId: word-count-1-1421738820, port: 1027, thread-id: 0 ]
6188 [Thread-6] INFO  backtype.storm.daemon.worker - Worker has topology config {"storm.id" "word-count-1-1421738820", "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.tick.tuple.freq.secs" nil, "topology.builtin.metrics.bucket.size.secs" 60, "topology.fall.back.on.java.serialization" true, "topology.max.error.report.per.interval" 5, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.messaging.netty.client_worker_threads" 1, "ui.childopts" "-Xmx768m", "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "topology.trident.batch.emit.interval.millis" 50, "storm.messaging.netty.flush.check.interval.ms" 10, "nimbus.monitor.freq.secs" 10, "logviewer.childopts" "-Xmx128m", "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "topology.executor.send.buffer.size" 1024, "storm.local.dir" "C:\\DOCUME~1\\ADMINI~1\\LOCALS~1\\Temp\\1405666e-4cf4-4d0d-9f34-046c64c47828", "storm.messaging.netty.buffer_size" 5242880, "supervisor.worker.start.timeout.secs" 120, "topology.enable.message.timeouts" true, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "drpc.worker.threads" 64, "storm.meta.serialization.delegate" "backtype.storm.serialization.DefaultSerializationDelegate", "topology.worker.shared.thread.pool.size" 4, "nimbus.host" "localhost", "storm.messaging.netty.min_wait_ms" 100, "storm.zookeeper.port" 2000, "transactional.zookeeper.port" nil, "topology.executor.receive.buffer.size" 1024, "transactional.zookeeper.servers" nil, "storm.zookeeper.root" "/storm", "storm.zookeeper.retry.intervalceiling.millis" 30000, "supervisor.enable" true, "storm.messaging.netty.server_worker_threads" 1, "storm.zookeeper.servers" ["localhost"], "transactional.zookeeper.root" "/transactional", "topology.acker.executors" nil, "topology.kryo.decorators" (), "topology.name" "word-count", "topology.transfer.buffer.size" 1024, "topology.worker.childopts" nil, "drpc.queue.size" 128, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "topology.error.throttle.interval.secs" 10, "zmq.hwm" 0, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "drpc.childopts" "-Xmx768m", "topology.receiver.buffer.size" 8, "task.heartbeat.frequency.secs" 3, "topology.tasks" nil, "storm.messaging.netty.max_retries" 300, "topology.spout.wait.strategy" "backtype.storm.spout.SleepSpoutWaitStrategy", "nimbus.thrift.max_buffer_size" 1048576, "topology.max.spout.pending" nil, "storm.zookeeper.retry.interval" 1000, "topology.sleep.spout.wait.strategy.time.ms" 1, "nimbus.topology.validator" "backtype.storm.nimbus.DefaultTopologyValidator", "supervisor.slots.ports" (1027 1028 1029), "topology.environment" nil, "topology.debug" true, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.kryo.register" nil, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx256m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "topology.tuple.serializer" "backtype.storm.serialization.types.ListDelegateSerializer", "topology.disruptor.wait.strategy" "com.lmax.disruptor.BlockingWaitStrategy", "topology.multilang.serializer" "backtype.storm.multilang.JsonSerializer", "nimbus.task.timeout.secs" 30, "storm.zookeeper.connection.timeout" 15000, "topology.kryo.factory" "backtype.storm.serialization.DefaultKryoFactory", "drpc.invocations.port" 3773, "logviewer.port" 8000, "zmq.threads" 1, "storm.zookeeper.retry.times" 5, "topology.worker.receiver.thread.count" 1, "storm.thrift.transport" "backtype.storm.security.auth.SimpleTransportPlugin", "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.messaging.transport" "backtype.storm.messaging.netty.Context", "logviewer.appender.name" "A1", "storm.messaging.netty.max_wait_ms" 1000, "drpc.request.timeout.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "storm.cluster.mode" "local", "topology.max.task.parallelism" 3, "storm.messaging.netty.transfer.batch.size" 262144, "topology.classpath" nil}
6188 [Thread-6] INFO  backtype.storm.daemon.worker - Worker 59bac6b4-abad-487f-9d25-4ff73cfee414 for storm word-count-1-1421738820 on d0369c1e-3793-417a-8f7f-41cff14105a6:1027 has finished loading
6344 [Thread-16-split] INFO  backtype.storm.task.ShellBolt - Launched subprocess with pid 6372
6344 [Thread-16-split] INFO  backtype.storm.task.ShellBolt - Start checking heartbeat...
6344 [Thread-16-split] INFO  backtype.storm.daemon.executor - Prepared bolt split:(6)
6344 [Thread-14-split] INFO  backtype.storm.task.ShellBolt - Launched subprocess with pid 5612
6344 [Thread-14-split] INFO  backtype.storm.task.ShellBolt - Start checking heartbeat...
6344 [Thread-14-split] INFO  backtype.storm.daemon.executor - Prepared bolt split:(5)
6344 [Thread-18-split] INFO  backtype.storm.task.ShellBolt - Launched subprocess with pid 6412
6344 [Thread-18-split] INFO  backtype.storm.task.ShellBolt - Start checking heartbeat...
6344 [Thread-18-split] INFO  backtype.storm.daemon.executor - Prepared bolt split:(7)
14750 [main] INFO  backtype.storm.daemon.nimbus - Shutting down master
14750 [ProcessThread(sid:0 cport:-1):] INFO  org.apache.storm.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14b063cbaca0001
14985 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Session: 0x14b063cbaca0001 closed
14985 [main-EventThread] INFO  org.apache.storm.zookeeper.ClientCnxn - EventThread shut down
14985 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:1374 which had sessionid 0x14b063cbaca0001
14985 [main] INFO  backtype.storm.daemon.nimbus - Shut down master
15000 [ProcessThread(sid:0 cport:-1):] INFO  org.apache.storm.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14b063cbaca0003
15031 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Session: 0x14b063cbaca0003 closed
15031 [main-EventThread] INFO  org.apache.storm.zookeeper.ClientCnxn - EventThread shut down
15031 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:1380 which had sessionid 0x14b063cbaca0003
15031 [ProcessThread(sid:0 cport:-1):] INFO  org.apache.storm.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14b063cbaca0005
15047 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Session: 0x14b063cbaca0005 closed
15047 [main-EventThread] INFO  org.apache.storm.zookeeper.ClientCnxn - EventThread shut down
15047 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:1386 which had sessionid 0x14b063cbaca0005
15047 [main] INFO  backtype.storm.daemon.supervisor - Shutting down supervisor 350e6c42-5223-4d66-973d-c1f4b06768ec
15047 [Thread-3] INFO  backtype.storm.event - Event manager interrupted
15047 [Thread-4] INFO  backtype.storm.event - Event manager interrupted
15047 [ProcessThread(sid:0 cport:-1):] INFO  org.apache.storm.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x14b063cbaca0007
15063 [main] INFO  org.apache.storm.zookeeper.ZooKeeper - Session: 0x14b063cbaca0007 closed
15063 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO  org.apache.storm.zookeeper.server.NIOServerCnxn - Closed socket connection for client /127.0.0.1:1392 which had sessionid 0x14b063cbaca0007
15063 [main-EventThread] INFO  org.apache.storm.zookeeper.ClientCnxn - EventThread shut down
15063 [main] INFO  backtype.storm.daemon.supervisor - Shutting down d0369c1e-3793-417a-8f7f-41cff14105a6:59bac6b4-abad-487f-9d25-4ff73cfee414
15063 [main] INFO  backtype.storm.process-simulator - Killing process 179b796b-6f45-4d89-a298-367ebf768af9
15063 [main] INFO  backtype.storm.daemon.worker - Shutting down worker word-count-1-1421738820 d0369c1e-3793-417a-8f7f-41cff14105a6 1027
15063 [main] INFO  backtype.storm.daemon.worker - Shutting down receive thread
15063 [main] INFO  backtype.storm.messaging.loader - Shutting down receiving-thread: [word-count-1-1421738820, 1027]
15063 [main] INFO  backtype.storm.messaging.loader - Waiting for receiving-thread:[word-count-1-1421738820, 1027] to die
15063 [Thread-29-worker-receiver-thread-0] INFO  backtype.storm.messaging.loader - Receiving-thread:[word-count-1-1421738820, 1027] received shutdown notice
15063 [main] INFO  backtype.storm.messaging.loader - Shutdown receiving-thread: [word-count-1-1421738820, 1027]
15063 [main] INFO  backtype.storm.daemon.worker - Shut down receive thread
15063 [main] INFO  backtype.storm.daemon.worker - Terminating messaging context
15063 [main] INFO  backtype.storm.daemon.worker - Shutting down executors
15063 [main] INFO  backtype.storm.daemon.executor - Shutting down executor count:[2 2]
15063 [Thread-7-disruptor-executor[2 2]-send-queue] INFO  backtype.storm.util - Async loop interrupted!
15063 [Thread-8-count] INFO  backtype.storm.util - Async loop interrupted!
15063 [main] INFO  backtype.storm.daemon.executor - Shut down executor count:[2 2]
15063 [main] INFO  backtype.storm.daemon.executor - Shutting down executor count:[3 3]
15063 [Thread-10-count] INFO  backtype.storm.util - Async loop interrupted!
15063 [Thread-9-disruptor-executor[3 3]-send-queue] INFO  backtype.storm.util - Async loop interrupted!
15063 [main] INFO  backtype.storm.daemon.executor - Shut down executor count:[3 3]
15063 [main] INFO  backtype.storm.daemon.executor - Shutting down executor count:[4 4]
15063 [Thread-12-count] INFO  backtype.storm.util - Async loop interrupted!
15063 [Thread-11-disruptor-executor[4 4]-send-queue] INFO  backtype.storm.util - Async loop interrupted!
15063 [main] INFO  backtype.storm.daemon.executor - Shut down executor count:[4 4]
15063 [main] INFO  backtype.storm.daemon.executor - Shutting down executor split:[5 5]
15063 [Thread-14-split] INFO  backtype.storm.util - Async loop interrupted!
15063 [Thread-13-disruptor-executor[5 5]-send-queue] INFO  backtype.storm.util - Async loop interrupted!
15063 [main] INFO  backtype.storm.daemon.executor - Shut down executor split:[5 5]
15063 [main] INFO  backtype.storm.daemon.executor - Shutting down executor split:[6 6]
15063 [Thread-16-split] INFO  backtype.storm.util - Async loop interrupted!
15063 [Thread-15-disruptor-executor[6 6]-send-queue] INFO  backtype.storm.util - Async loop interrupted!
15063 [main] INFO  backtype.storm.daemon.executor - Shut down executor split:[6 6]
15078 [main] INFO  backtype.storm.daemon.executor - Shutting down executor split:[7 7]
15078 [Thread-18-split] INFO  backtype.storm.util - Async loop interrupted!
15078 [Thread-17-disruptor-executor[7 7]-send-queue] INFO  backtype.storm.util - Async loop interrupted!
15078 [main] INFO  backtype.storm.daemon.executor - Shut down executor split:[7 7]
15078 [main] INFO  backtype.storm.daemon.executor - Shutting down executor spout:[8 8]
15078 [Thread-20-spout] INFO  backtype.storm.util - Async loop interrupted!
15078 [Thread-19-disruptor-executor[8 8]-send-queue] INFO  backtype.storm.util - Async loop interrupted!
15078 [main] INFO  backtype.storm.daemon.executor - Shut down executor spout:[8 8]
15078 [main] INFO  backtype.storm.daemon.executor - Shutting down executor spout:[9 9]
15078 [Thread-22-spout] INFO  backtype.storm.util - Async loop interrupted!
15078 [Thread-21-disruptor-executor[9 9]-send-queue] INFO  backtype.storm.util - Async loop interrupted!
15078 [main] INFO  backtype.storm.daemon.executor - Shut down executor spout:[9 9]
15078 [main] INFO  backtype.storm.daemon.executor - Shutting down executor spout:[10 10]
15078 [Thread-24-spout] INFO  backtype.storm.util - Async loop interrupted!
15078 [Thread-23-disruptor-executor[10 10]-send-queue] INFO  backtype.storm.util - Async loop interrupted!
15078 [main] INFO  backtype.storm.daemon.executor - Shut down executor spout:[10 10]
15078 [main] INFO  backtype.storm.daemon.executor - Shutting down executor __system:[-1 -1]
15078 [Thread-26-__system] INFO  backtype.storm.util - Async loop interrupted!
15078 [Thread-25-disruptor-executor[-1 -1]-send-queue] INFO  backtype.storm.util - Async loop interrupted!
15078 [main] INFO  backtype.storm.daemon.executor - Shut down executor __system:[-1 -1]
15078 [main] INFO  backtype.storm.daemon.executor - Shutting down executor __acker:[1 1]
15078 [Thread-28-__acker] INFO  backtype.storm.util - Async loop interrupted!
15078 [Thread-27-disruptor-executor[1 1]-send-queue] INFO  backtype.storm.util - Async loop interrupted!
15078 [main] INFO  backtype.storm.daemon.executor - Shut down executor __acker:[1 1]
15078 [main] INFO  backtype.storm.daemon.worker - Shut down executors
15078 [main] INFO  backtype.storm.daemon.worker - Shutting down transfer thread
15078 [Thread-30-disruptor-worker-transfer-queue] INFO  backtype.storm.util - Async loop interrupted!
15078 [main] INFO  backtype.storm.daemon.worker - Shut down transfer thread
15078 [Thread-33] ERROR backtype.storm.task.ShellBolt - Halting process: ShellBolt died.


追寻北极
关注
  • 0
    点赞
  • 踩
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
Storm API实现词频统计
05-30
在大数据处理领域，Apache Storm是一个实时计算系统，它能够持续处理数据流，实现低延迟、高吞吐量的数据分析。在这个“Storm API实现词频统计”的案例中，我们将深入探讨如何利用Java编程语言和Storm API来构建一个...
Storm实时日志分析实战
lavimer
04-29 7665
项目背景 最近公司做一个项目，用户需要对网站访问者的广告点击/浏览记录进行实时统计分析，分析结果存入数据库，输出报表。我们采用了Kafka+Storm+Zookeeper的解决方案。之前没有接触过，经过一段时间的研究，最终完成了项目。接下来的内容我将介绍我们的解决方案。供大家参考。我们的系统结构如下： 总体结构介绍 业务系统把点击/浏览广告业务日志统一按规定的格式发送到Kafka集群
大数据_Storm_Storm之--配置项详解
迎难而上
08-11 5764
转载请注明出处:http://blog.csdn.net/l1028386804/article/details/51924272 配置项 配置说明 storm.zookeeper.servers ZooKeeper服务器列表 storm.zookeeper.port ZooKeeper连接端口
关于 flink 执行SocketWindowWordCount程序报错 ：Job execution failed.
qq_34841911的博客
01-28 6733
我自个第一次执行flink 的SocketWindowWordCount 程序是，报一个:Caused by: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Not enough free slots available to run the job. You can decrease the
Storm 多语言支持之ShellBolt原理及改进
jmppok的专栏
01-02 5264
Storm是一个实时分布式流处理框架，现在正被越来越多的人使用。众所周知，Storm是一个Java平台，这就给我们的使用带来了一个问题：我们在实际工作中很少从0开始，往往是在一些已有的基础执行进行开发，而如果我们已有的基础程序不是Java平台而是C/C++，python等，如何将其移植到Storm中运行呢？ 为了解决这个问题，Storm本身提出了ShellBolt，用于支持由不同语言便编写的程序在Storm平台中运行。
storm启动后不打印日志，提交Topology后也不打印日志
BrotherDong90的专栏
06-12 7811
今天遇到个问题，启动Storm集群后，logs目录下没有任何日志，提交topology任务后，任务能够正常运行，但是还是没有任何worker日志。以为是配置错了。。疯狂的找配置对比。。。发现配置没问题。。。    最后看了一下，发现是因为我copy过来的这个storm安装目录下有以前的一个测试topology的jar包。。。。然后storm启动的时候把这些包一起当做lib一起加载了。然后就造成了
storm开发jar包以及storm例子源码
09-18
例如，`storm jar my-storm-topology.jar com.exampleTopology.WordCountTopology`会启动名为WordCountTopology的拓扑。 描述中提到的"仅供参考"提示，这些资源可能包含示例代码和说明，帮助初学者理解如何在Storm ...
storm-cli:Apache Storm 的 cli
07-22
主分支： 风暴-cli Apache Storm 的 cli 字数示例 set topology.name=test_topology; set storm.jar=./jstorm-example-0.9.0.jar;...REGISTER count=BOLT(1, "storm.starter.WordCountTopology$WordCount").FIE
jstorm文档
12-09
public class WordCountTopology { public static void main(String[] args) throws Exception { Config conf = new Config(); conf.setDebug(true); LocalCluster cluster = new LocalCluster(); cluster....
storm_wordcount.zip
08-01
在这个项目中，可能会有一个名为`WordCountTopology`的类，它定义了数据流的处理流程，包括Spouts（数据源）和Bolts（数据处理器）。 2. **Spout组件**：Spout是Storm中数据的输入源。在这个例子中，Spout可能读取...
storm local版本本地测试异常汇总
每天积累一点，一年后你会发现，自己变化很大
01-20 2695
1,报错如下： ava.lang.RuntimeException: Error when launching multilang subprocess Caused by: java.io.IOException: Cannot run program "python" (in directory "/tmp/eaf0b6b3-67c1-4f89-b3d8-23edada49b04/super
JSTORM命令
peopleandme的博客
09-26 495
jps 查看niumbus和supervisor进程 ./jstorm list 查看jstorm详细信息 [ducc@saas-billing-server-051 bin]$ ./jstorm list /opt/jdk1.8.0_162/bin/java Running: java -client -Xms256m -Xmx256m -Djstorm.home=/app/bss30_...
storm多种编程语言优缺点
yanhx1204的专栏
02-06 6567
除了用Java实现spout和bolt，你还可以使用任何你熟悉的编程语言来完成这项工作，这一切得益于Storm所谓的多语言协议。多语言协议是Storm内部的一种特殊协议，允许spout或者bolt使用标准输入和标准输出来进行消息传递，传递的消息为单行文本或者是json编码的多行。 Storm支持多语言编程主要是通过ShellBolt,ShellSpout和ShellProcess这些类来实现的，
使用IntelliJ IDEA导入storm-starter并测试WordCountTopology运行出现 A JNI error has occurred的原因和解决
热门推荐
moon_love_banana的博客
07-09 2万+
第一次导入storm包并测试WordCountTopology，出现如下截图错误： 解决方法： 1.查看POM文件： 上图的POM文件中配置参数为：provided 应改为：compile 如下图： 再次测试运行，ok了： "C:\Program Files\Java\jdk1.8.0_131\bin\java"
Twitter Storm：实时大数据流处理技术解析
例如，`WordCountTopology`是一个简单的例子，其中`Tweetspout`生成推文，`ParseTweetBolt`解析推文内容，然后其他Bolts统计每个单词出现的次数。 4. **操作经验与故障恢复**：Storm提供了强大的操作体验和故障恢复...
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值