flink 入门及安装

概念

如今，每个组织中都在大量使用实时处理。欺诈检测，医疗保健中的实时警报和网络攻击警报等用例需要实时处理即时数据。即使是几毫秒的延迟也会产生巨大的影响。这种实时用例的理想工具是可以输入数据流而不是批处理的工具。Apache Flink是该实时处理工具

安装

解压

[root@mypc01 bin]# tar -zxvf flink-1.12.0-bin-scala_2.11.gz -C /usr/local
# 去bin目录下启动
[root@mypc01 bin]# ./start-cluster.sh

登录webui查看

http://192.168.xx.101:8081/#/overview

测试 wordcount案例,自带的例子里面有,用flink命令执行

[root@mypc01 flink-1.12.0]# flink run examples/streaming/WordCount.jar
Executing WordCount example with default input data set.
Use --input to specify file input.
Printing result to stdout. Use --output to specify output path.
Job has been submitted with JobID 415fe39eb83b91294ad200961fe99bf1
Program execution finished
Job with JobID 415fe39eb83b91294ad200961fe99bf1 has finished.
Job Runtime: 1201 ms

[root@mypc01 flink-1.12.0]# tail log/flink-*-taskexecutor-*.out
(nymph,1)
(in,3)
(thy,1)
(orisons,1)
(be,4)
(all,2)
(my,1)
(sins,1)
(remember,1)
(d,4)

总结

• 使用flink run运行jar包
• 运行结果可以在log目录下查看

参考

Apache Flink 1.12 Documentation: Local Installation
https://ci.apache.org/projects/flink/flink-docs-release-1.12/try-flink/local_installation.html