OpaqueMap转换Snapshottable异常

使用MysqlState作为storm计算结果的持久化,程序运行出错如下:

12509 [Thread-24-b-1] ERROR backtype.storm.daemon.executor - 
java.lang.RuntimeException: java.lang.ClassCastException: storm.trident.state.map.OpaqueMap cannot be cast to storm.trident.state.snapshot.Snapshottable
	at backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:128) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at backtype.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:99) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at backtype.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:80) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at backtype.storm.daemon.executor$fn__3352$fn__3364$fn__3411.invoke(executor.clj:746) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at backtype.storm.util$async_loop$fn__452.invoke(util.clj:431) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
	at java.lang.Thread.run(Thread.java:662) [na:1.6.0_37]
Caused by: java.lang.ClassCastException: storm.trident.state.map.OpaqueMap cannot be cast to storm.trident.state.snapshot.Snapshottable
	at storm.trident.operation.impl.CombinerAggStateUpdater.updateState(CombinerAggStateUpdater.java:31) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at storm.trident.planner.processor.PartitionPersistProcessor.finishBatch(PartitionPersistProcessor.java:98) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at storm.trident.planner.SubtopologyBolt.finishBatch(SubtopologyBolt.java:152) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at storm.trident.topology.TridentBoltExecutor.finishBatch(TridentBoltExecutor.java:252) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at storm.trident.topology.TridentBoltExecutor.checkFinish(TridentBoltExecutor.java:285) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at storm.trident.topology.TridentBoltExecutor.execute(TridentBoltExecutor.java:359) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at backtype.storm.daemon.executor$fn__3352$tuple_action_fn__3354.invoke(executor.clj:631) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at backtype.storm.daemon.executor$mk_task_receiver$fn__3275.invoke(executor.clj:399) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at backtype.storm.disruptor$clojure_handler$reify__1437.onEvent(disruptor.clj:58) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
	at backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:125) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]

解决方法:

在persistentAggregate之前添加方法groupBy,参数的个数与类MysqlState中的方法multiGet(final List<List<Object>> keys)参数keys的size一致。

		.groupBy(new Fields("key1", "key2", "key3"))
		.persistentAggregate(MysqlState.newFactory(mysqlStateConfig), 










  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值