Java中time用什么属性,java—如何定义具有row time属性的apache flink表

我有json行作为数据,我想从中创建一个表。

StreamTableEnvironment fsTableEnv = StreamTableEnvironment.create(streamExecutionEnvironment, fsSettings);

String allEventsTable = "allEventsTable";

fsTableEnv.connect(new Kafka()

.version("0.11")

.topic("events")

.property("bootstrap.servers", "localhost:9092")

.property("group.id", "dummyquery").startFromLatest())

.withSchema(new Schema()

.field("rule_id", Types.INT)

.field("sourceAddress", Types.STRING)

.field("deviceProduct", Types.STRING)

.field("destHost", Types.STRING)

.field("extra", Types.STRING)

.field("rowtime", Types.SQL_TIMESTAMP)

.rowtime(new Rowtime().timestampsFromField("rowtime").watermarksPeriodicBounded(2000))

)

.withFormat(new Json().failOnMissingField(false).deriveSchema())

.inAppendMode()

.registerTableSource(allEventsTable);

Table result = fsTableEnv.sqlQuery("select * from allEventsTable where sourceAddress='12345431'");

DataStream alert = fsTableEnv.toAppendStream(result, Row.class);

alert.print();

但是,在运行 job时,我得到了错误

Exception in thread "main" org.apache.flink.table.api.ValidationException: Field 'rowtime' could not be resolved by the field mapping.

at org.apache.flink.table.sources.TableSourceValidation.resolveField(TableSourceValidation.java:245)

at org.apache.flink.table.sources.TableSourceValidation.lambda$validateTimestampExtractorArguments$6(TableSourceValidation.java:202)

at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)

at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)

at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)

at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)

at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:545)

at java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260)

at java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:438)

我用的是火石1.9

我放入kafka主题事件中的json数据如下所示

{"rule_id":"", "rowtime":"2020-07-23 13:10:13","sourceAddress":"12345433","deviceProduct":"234r5t", "destHost":"876543", "extra":"dummy"}

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值