storm学习笔记

最新推荐文章于 2024-10-05 12:07:50 发布

wangqiaowqo

最新推荐文章于 2024-10-05 12:07:50 发布

阅读量120

点赞数

分类专栏： storm 文章标签： java 大数据

本文链接：https://blog.csdn.net/wangqiaowqo/article/details/84618173

版权

storm 专栏收录该内容

7 篇文章 0 订阅

订阅专栏

storm 推荐学习资料
http://blog.linezing.com/?cat=92
http://wiki.1verge.net/das:data:dp:storm:test_use
http://wiki.1verge.net/das:data:dp:mq:start

1、开发完成后
通过以下命令启动集群：
mvn compile -X exec:java -Dexec.classpathScope=compile-Djava.net.preferIPv4Stack=true -Dexec.mainClass=com.youku.stormtest.HelloWorldTopology

测试：
http://tianhailong.com/%E6%9C%AC%E5%9C%B0%E6%A8%A1%E5%BC%8F%E8%BF%90%E8%A1%8Cstorm%E7%9A%84demo.html

异常：


325  [main-SendThread(localhost:2000)] WARN  org.apache.zookeeper.ClientCnxn  - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.SocketException: Address family not supported by protocol family: connect
	at sun.nio.ch.Net.connect(Native Method)
	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1050)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1077)

解决方法：
ping localhost，如果没有正确回应把hosts文件配置一下试试！
运行main class的时候添加“-Djava.net.preferIPv4Stack=true”参数试试！


[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.3.1:java (default-cli) on project stormtest: An exception occured while executing the Java
class. null: InvocationTargetException: Unable to delete file: C:\Users\wangqiao\AppData\Local\Temp\fa2cda1e-6771-46f1-bfc1-614b1a32c7de\version-2\log.1 -> [Hel
p 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.3.1:java (default-cli) on project stormtest
: An exception occured while executing the Java class. null
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
        at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
        at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
        at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
        at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
        at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
        at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
        at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
        at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
        at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: An exception occured while executing the Java class. null
        at org.codehaus.mojo.exec.ExecJavaMojo.execute(ExecJavaMojo.java:345)
        at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
        ... 19 more
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Unable to delete file: C:\Users\wangqiao\AppData\Local\Temp\fa2cda1e-6771-46f1-bfc1-614b1a32c7de\version-2\log.1
        at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:1390)
        at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1044)
        at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:977)
        at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:1381)
        at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1044)
        at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:977)
        at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:1381)
        at backtype.storm.util$rmr.invoke(util.clj:413)
        at backtype.storm.testing$kill_local_storm_cluster.invoke(testing.clj:163)
        at backtype.storm.LocalCluster$_shutdown.invoke(LocalCluster.clj:25)
        at backtype.storm.LocalCluster.shutdown(Unknown Source)
        at com.youku.stormtest.HelloWorldTopology.main(HelloWorldTopology.java:35)
        ... 6 more

方式一、将 //cluster.shutdown(); 注释掉不关闭本地集群

方式二、
这是storm的一个bug，0.8.2版本还没有解决，这个错误在cluster.shutdown();时候抛出，没有什么好解决办法，注释掉shutdown()方法程序将不会自己停止，这个错误影响有限，忽略它吧。
http://www.myexception.cn/software-architecture-design/1458289.html

4、本地运行storm demo
http://tianhailong.com/%E6%9C%AC%E5%9C%B0%E6%A8%A1%E5%BC%8F%E8%BF%90%E8%A1%8Cstorm%E7%9A%84demo.html

5、安装教程
http://www.cnblogs.com/panfeng412/archive/2012/11/30/how-to-install-and-deploy-storm-cluster.html