storm 2.2.1 java + idea实现基本demo jar包提交执行

storm 2.2.1 java + idea实现基本demo的基础上,本地开发环境执行成功后,需要提交到storm的测试或生产环境,此时需要将项目打包成jar,然后再进行提交。

1. 配置pom.xml文件打包成jar

打包需要指定打包类型和名称。

<packaging>jar</packaging>
<name>storm-helloworld</name>

由于运行环境已经有依赖包了,所以不需要storm-core,所以需要修改scope。

<dependency>
            <groupId>org.apache.storm</groupId>
            <artifactId>storm-core</artifactId>
            <version>2.2.1</version>
            <scope>provided</scope>
</dependency>

添加打包组件

<build>
        <plugins>
            <plugin>
                <artifactId>maven-assembly-plugin</artifactId>
                <configuration>
                    <descriptorRefs>
                        <descriptorRef>jar-with-dependencies</descriptorRef>
                    </descriptorRefs>
                    <archive>
                        <manifest>
                            <mainClass>com.demo.storm.ExclamationTopology</mainClass>
                        </manifest>
                    </archive>
                </configuration>
            </plugin>
        </plugins>
    </build>

 执行打包命令:

mvn assembly:assembly

在target找到storm-helloworld-1.0-SNAPSHOT-jar-with-dependencies.jar,这就是可以提交到storm环境进行执行的jar包。 

2. 执行jar包提交

D:\sdks\apache-storm-2.2.1\bin>storm.py jar storm-helloworld-1.0-SNAPSHOT-jar-with-dependencies.jar com.demo.storm.ExclamationTopology ExclamationTest
Running: D:\sdks\jdk1.8.0_191\bin\java.exe -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=D:\sdks\apache-storm-2.2.1 -Dstorm.log.dir=D:\sdks\apache-storm-2.2.1\logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/lib64 -Dstorm.conf.file= -cp D:\sdks\apache-storm-2.2.1\*;D:\sdks\apache-storm-2.2.1\lib-worker\*;D:\sdks\apache-storm-2.2.1\extlib\*;storm-helloworld-1.0-SNAPSHOT-jar-with-dependencies.jar;D:\sdks\apache-storm-2.2.1\conf;D:\sdks\apache-storm-2.2.1\bin; -Dstorm.jar=storm-helloworld-1.0-SNAPSHOT-jar-with-dependencies.jar -Dstorm.dependency.jars= -Dstorm.dependency.artifacts={} com.demo.storm.ExclamationTopology ExclamationTest
13:23:00.263 [main] INFO  o.a.s.StormSubmitter - Generated ZooKeeper secret payload for MD5-digest: -8787587062738558446:-8083876763536322029
13:23:00.314 [main] WARN  o.a.s.v.ConfigValidation - task.heartbeat.frequency.secs is a deprecated config please see class org.apache.storm.Config.TASK_HEARTBEAT_FREQUENCY_SECS for more information.
13:23:00.392 [main] INFO  o.a.s.u.NimbusClient - Found leader nimbus : DESKTOP-O93E7VQ:6627
13:23:00.393 [main] INFO  o.a.s.s.a.ClientAuthUtils - Got AutoCreds []
13:23:00.422 [main] INFO  o.a.s.StormSubmitter - Uploading dependencies - jars...
13:23:00.423 [main] INFO  o.a.s.StormSubmitter - Uploading dependencies - artifacts...
13:23:00.423 [main] INFO  o.a.s.StormSubmitter - Dependency Blob keys - jars : [] / artifacts : []
13:23:00.437 [main] INFO  o.a.s.StormSubmitter - Uploading topology jar storm-helloworld-1.0-SNAPSHOT-jar-with-dependencies.jar to assigned location: D:\sdks\apache-storm-2.2.1\storm-local\nimbus\inbox/stormjar-4c0ffedd-8447-4d5f-89a1-1632e5a9f88c.jar
Start uploading file 'storm-helloworld-1.0-SNAPSHOT-jar-with-dependencies.jar' to 'D:\sdks\apache-storm-2.2.1\storm-local\nimbus\inbox/stormjar-4c0ffedd-8447-4d5f-89a1-1632e5a9f88c.jar' (4890 bytes)
[==================================================] 4890 / 4890
File 'storm-helloworld-1.0-SNAPSHOT-jar-with-dependencies.jar' uploaded to 'D:\sdks\apache-storm-2.2.1\storm-local\nimbus\inbox/stormjar-4c0ffedd-8447-4d5f-89a1-1632e5a9f88c.jar' (4890 bytes)
13:23:00.465 [main] INFO  o.a.s.StormSubmitter - Successfully uploaded topology jar to assigned location: D:\sdks\apache-storm-2.2.1\storm-local\nimbus\inbox/stormjar-4c0ffedd-8447-4d5f-89a1-1632e5a9f88c.jar
13:23:00.465 [main] INFO  o.a.s.StormSubmitter - Submitting topology ExclamationTest in distributed mode with conf {"storm.zookeeper.topology.auth.scheme":"digest","storm.zookeeper.topology.auth.payload":"-8787587062738558446:-8083876763536322029","topology.workers":3,"topology.debug":false}
13:23:00.655 [main] INFO  o.a.s.StormSubmitter - Finished submitting topology: ExclamationTest

3. 查看运行状态信息

http://localhost:8080/topology.html?id=ExclamationTest-1-1643347380

3.1 topology状态信息

3.2 输入和执行信息

3.3 worker信息

3.4 可视化

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值