window环境下使用IDEA开发第一个Fink程序Wordcount

1.下载netcat并解压,在当前目录下执行nc.exe -l -p 9000
注意:有些杀毒软件会阻拦
nc
2.在IDEA编写代码(注:一定要引入防止出现隐式转换出错 org.apache.flink.streaming.api.scala.
import org.apache.flink.streaming.api.scala.

import org.apache.flink.streaming.api.scala.StreamExecutionEnvironment
import org.apache.flink.streaming.api.windowing.time.Time

object SocketWindowWordCount {

def main(args: Array[String]) : Unit = {
// get the execution environment
val env: StreamExecutionEnvironment = StreamExecutionEnvironment.getExecutionEnvironment

// get input data by connecting to the socket
val text = env.socketTextStream("localhost", 9000, '\n')

// parse the data, group it, window it, and aggregate the counts
val windowCounts = text
  .flatMap { w => w.split("\\s") }
  .map { w => WordWithCount(w, 1) }
  .keyBy("word")
  .timeWindow(Time.seconds(5), Time.seconds(1))
  .sum("count")

// print the results with a single thread, rather than in parallel
windowCounts.print().setParallelism(1)

env.execute("Socket Window WordCount")

}

// Data type for words with count
case class WordWithCount(word: String, count: Long)
}
3.执行结果(注:一定要先执行IDEA程序后才在netcat的dos界面输入数据)
flink

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值