flinksql进行相关计算模型

1,flinksql如下:

 CREATE TABLE SourTable (
                      carid VARCHAR,
                      utime BIGINT,
                      accountId VARCHAR,
                      uuid VARCHAR,
                      upBytes BIGINT,
                      downBytes BIGINT,
                      usedBytes BIGINT,
                      bssid VARCHAR,
                      mac VARCHAR,
                      ip VARCHAR,
                      status INT,
                      uphone VARCHAR,
                      options VARCHAR
                     ) WITH (
                      'connector.type' = 'kafka',
                      'connector.property-version' = '1',
		      'connector.version' = '0.10',	
                      'connector.topic' = 'flink_old_open_wifi_dwd',
                      'update-mode' = 'append',
                      'connector.properties.0.key' = 'bootstrap.servers',
                      'connector.properties.0.value' = '10.2.2.8:9092',
                      'connector.properties.1.key' = 'group.id',
                      'connector.properties.1.value' = 'flink-liqiang-flow',
                      'connector.properties.2.key' = 'key.deserializer',
                      'connector.properties.2.value' = 'org.apache.kafka.common.serialization.StringSerializer',
                      'connector.properties.3.key' = 'value.deserializer',
                      'connector.properties.3.value' = 'org.apache.kafka.common.serialization.StringSerializer',
                      'connector.startup-mode' = 'latest-offset',
                      'connector.sink-partitioner' = 'round-robin',
                      'format.type' = 'json',
                      'format.property-version' = '1',
                      'format.derive-schema' = 'true'
                    );
 CREATE TABLE SinkTable (
		      biztime BIGINT,
                      bizDate VARCHAR,
                      mac VARCHAR,
                      phone VARCHAR
                     ) WITH (
                      'connector.type' = 'kafka-gt',
                      'connector.property-version' = '1',
                      'connector.topic' = 'flink_first_flow_drf_dws',
                      'update-mode' = 'append',
                      'connector.properties.0.key' = 'bootstrap.servers',
                      'connector.properties.0.value' = '10.2.2.8:9092',
                      'connector.properties.1.key' = 'group.id',
                      'connector.properties.1.value' = 'flink-liqiang-flow',
                      'connector.properties.2.key' = 'key.deserializer',
                      'connector.properties.2.value' = 'org.apache.kafka.common.serialization.StringSerializer',
                      'connector.properties.3.key' = 'value.deserializer',
                      'connector.properties.3.value' = 'org.apache.kafka.common.serialization.StringSerializer',
                      'connector.startup-mode' = 'latest-offset',
                      'connector.sink-partitioner' = 'round-robin',
                      'format.type' = 'json',
                      'format.property-version' = '1',
                      'format.derive-schema' = 'true'
                    );

#主要对日期做处理,主要对时间进行 FROM_UNIXTIME 处理
insert into SinkTable
select min(utime) as biztime,FROM_UNIXTIME(utime/1000,'yyyy-MM-dd') as bizDate,mac,max(uphone) as phone  from SourTable
where FROM_UNIXTIME(utime/1000,'yyyy-MM-dd')  = DATE_FORMAT(LOCALTIMESTAMP,'yyyy-MM-dd')  group by FROM_UNIXTIME(utime/1000,'yyyy-MM-dd'),mac having count(mac) = 1;

 

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值