Storm TopologyBuilder

org.apache.storm.topology

Class TopologyBuilder

• java.lang.Object
• • org.apache.storm.topology.TopologyBuilder

• ---

  
  

  public class TopologyBuilder
  extends Object

  TopologyBuilder exposes the Java API for specifying a topology for Storm to execute. Topologies are Thrift structures in the end, but since the Thrift API is so verbose（冗长的|罗嗦的）, TopologyBuilder greatly eases the process of creating topologies. The template for creating and submitting a topology looks something like:

  TopologyBuilder builder = new TopologyBuilder();
  
  builder.setSpout("1", new TestWordSpout(true), 5);
  builder.setSpout("2", new TestWordSpout(true), 3);
  builder.setBolt("3", new TestWordCounter(), 3)
           .fieldsGrouping("1", new Fields("word"))
           .fieldsGrouping("2", new Fields("word"));
  builder.setBolt("4", new TestGlobalCount())
           .globalGrouping("1");
  
  Map conf = new HashMap();
  conf.put(Config.TOPOLOGY_WORKERS, 4);
  
  StormSubmitter.submitTopology("mytopology", conf, builder.createTopology());
  

  Running the exact same topology in local mode (in process), and configuring it to log all tuples emitted（发出|放出）, looks like the following. Note that it lets the topology run for 10 seconds before shutting down the local cluster.

  TopologyBuilder builder = new TopologyBuilder();
  
  builder.setSpout("1", new TestWordSpout(true), 5);
  builder.setSpout("2", new TestWordSpout(true), 3);
  builder.setBolt("3", new TestWordCounter(), 3)
           .fieldsGrouping("1", new Fields("word"))
           .fieldsGrouping("2", new Fields("word"));
  builder.setBolt("4", new TestGlobalCount())
           .globalGrouping("1");
  
  Map conf = new HashMap();
  conf.put(Config.TOPOLOGY_WORKERS, 4);
  conf.put(Config.TOPOLOGY_DEBUG, true);
  
  LocalCluster cluster = new LocalCluster();
  cluster.submitTopology("mytopology", conf, builder.createTopology());
  Utils.sleep(10000);
  cluster.shutdown();
  

  The pattern for TopologyBuilder is to map component ids to components using the setSpout and setBolt methods. Those methods return objects that are then used to declare the inputs for that component.