1. Flink集群安装
(1) 下载flink:
flink-1.13.1-bin-scala_2.11.tgz
https://flink.apache.org/downloads.html
(2)上传flink到linux
conf/master
hdp1:8081
conf/workers
hdp1
hdp2
hdp3
flink-conf.yaml
修改:jobmanager.rpc.address: hdp1
添加:classloader.resolve-order: parent-first
Stream测试案例:
$ tar -xzf flink-1.13.0-bin-scala_2.11.tgz
$ cd flink-1.13.0-bin-scala_2.11
$ ./bin/start-cluster.sh
Starting cluster.
Starting standalonesession daemon on host.
Starting taskexecutor daemon on host.
$ ./bin/flink run examples/streaming/WordCount.jar
$ tail log/flink-*-taskexecutor-*.out
(to,1)
(be,1)
(or,1)
(not,1)
(to,2)
(be,2)
或WebUI TaskManagers->Stdout查看示例结果
Batch测试案例:
./bin/f