使用MysqlState作为storm计算结果的持久化,程序运行出错如下:
12509 [Thread-24-b-1] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: java.lang.ClassCastException: storm.trident.state.map.OpaqueMap cannot be cast to storm.trident.state.snapshot.Snapshottable
at backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:128) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:99) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:80) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.daemon.executor$fn__3352$fn__3364$fn__3411.invoke(executor.clj:746) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.util$async_loop$fn__452.invoke(util.clj:431) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:662) [na:1.6.0_37]
Caused by: java.lang.ClassCastException: storm.trident.state.map.OpaqueMap cannot be cast to storm.trident.state.snapshot.Snapshottable
at storm.trident.operation.impl.CombinerAggStateUpdater.updateState(CombinerAggStateUpdater.java:31) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at storm.trident.planner.processor.PartitionPersistProcessor.finishBatch(PartitionPersistProcessor.java:98) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at storm.trident.planner.SubtopologyBolt.finishBatch(SubtopologyBolt.java:152) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at storm.trident.topology.TridentBoltExecutor.finishBatch(TridentBoltExecutor.java:252) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at storm.trident.topology.TridentBoltExecutor.checkFinish(TridentBoltExecutor.java:285) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at storm.trident.topology.TridentBoltExecutor.execute(TridentBoltExecutor.java:359) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.daemon.executor$fn__3352$tuple_action_fn__3354.invoke(executor.clj:631) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.daemon.executor$mk_task_receiver$fn__3275.invoke(executor.clj:399) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.disruptor$clojure_handler$reify__1437.onEvent(disruptor.clj:58) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:125) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
解决方法:
在persistentAggregate之前添加方法groupBy,参数的个数与类MysqlState中的方法multiGet(final List<List<Object>> keys)参数keys的size一致。
.groupBy(new Fields("key1", "key2", "key3"))
.persistentAggregate(MysqlState.newFactory(mysqlStateConfig),