Flink原理实战每日一篇10

继续讲Flink Table ..........................

这一篇就有点乱七八糟了,都是写案例,说实话,在实际开发中都是Flink SQL,在这里我们还是手写API 然后过了,把重心放在SQL上面。。。。

下面全是手写案例 :

1)

object Over_window {
  def main(args: Array[String]): Unit = {

    val env = StreamExecutionEnvironment.getExecutionEnvironment


    //todo 创建tableEnv
    val tableEnv = TableEnvironment.getTableEnvironment(env)
    val stream = env.fromElements(("aa", 192L), ("aa", 192L),("bb", 112L))

    val table: Table = tableEnv.fromDataStream(stream, 'id, 'time)

    //todo 主要四个参数   partitionBy ,  orderBy ,  preceding (following,与preceding相反)
    table.window(Over partitionBy 'id orderBy 'rowtime preceding UNBOUNDED_RANGE as 'window)
      .select('id,'time.sum over 'window,'time.max over 'window)


    //todo Over Window 聚合操作
    val rs: Table =table.window(Over partitionBy 'id orderBy 'rowtime preceding UNBOUNDED_RANGE as 'window)
      .select('id,'id.avg over 'window,'time.max over 'window)

    //todo 去重

    val distinctRs: Table = table.window(Over partitionBy 'id orderBy 'rowtime preceding UNBOUNDED_RANGE as 'window)
      .select('id,'id.avg over 'window,'time.max over 'window)

    table.distinct()
  }
}

 

2)

object Table_API {
  def main(args: Array[String]): Unit = {
    val env = StreamExecutionEnvironment.getExecutionEnvironment


    //todo 创建tableEnv
    val tableEnv = TableEnvironment.getTableEnvironment(env)
    val stream = env.fromElements(("aa", 192L), ("aa", 192L))
    val table: Table = tableEnv.fromDataStream(stream, 'id, 'name)

    tableEnv.registerDataStream("table2", stream, 'myLong, 'myString)


    //todo sql查询然后转成流
    val rs: DataStream[(Boolean, (String, Long))] = table.groupBy
  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值