Apache Flink源码阅读环境搭建

Apache Flink源码阅读环境搭建

版本
win7
jdk 1.8
maven 3.6.3
scala 2.11.8

这些必须提前安装好

1 下载源码

# 下载源码
git clone https://github.com/apache/spark.git
# flink是用tag区分不同版本的,切换到目标版本
 git checkout -b release-1.13.0

2 编译打包

在项目根目录打开Git Bash
运行如下命令

# 设置大一点的内存,防止内存溢出
export MAVEN_OPTS="-Xmx2g -XX:ReservedCodeCacheSize=512m"
# 执行打包命令,这里只是阅读源码所以用快速打包
mvn clean install -DskipTests -Dfast

打包完成
在这里插入图片描述

3 导入项目

在这里插入图片描述

4 debug

1.运行
双击shift搜索WordCount.scala,右键Run ‘WordCount’
这里可能会报个错

在这里插入图片描述
点击Edit Configurations…,修改如下参数
Before lauch:Build,Activate tool window

在这里插入图片描述
在这里插入图片描述
再次右键Run ‘WordCount’

D:\Java\jdk1.8.0_121\bin\java -javaagent:D:\IntelliJ_IDEA\idea2018\lib\idea_rt.jar=59227:D:\IntelliJ_IDEA\idea2018\bin -Dfile.encoding=UTF-8 -classpath D:\Java\jdk1.8.0_121\jre\lib\charsets.jar;D:\Java\jdk1.8.0_121\jre\lib\deploy.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\access-bridge-64.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\cldrdata.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\dnsns.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\jaccess.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\jfxrt.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\localedata.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\nashorn.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\sunec.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\sunjce_provider.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\sunmscapi.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\sunpkcs11.jar;D:\Java\jdk1.8.0_121\jre\lib\ext\zipfs.jar;D:\Java\jdk1.8.0_121\jre\lib\javaws.jar;D:\Java\jdk1.8.0_121\jre\lib\jce.jar;D:\Java\jdk1.8.0_121\jre\lib\jfr.jar;D:\Java\jdk1.8.0_121\jre\lib\jfxswt.jar;D:\Java\jdk1.8.0_121\jre\lib\jsse.jar;D:\Java\jdk1.8.0_121\jre\lib\management-agent.jar;D:\Java\jdk1.8.0_121\jre\lib\plugin.jar;D:\Java\jdk1.8.0_121\jre\lib\resources.jar;D:\Java\jdk1.8.0_121\jre\lib\rt.jar;E:\os_workspace\flink\flink-examples\flink-examples-streaming\target\classes;E:\os_workspace\flink\flink-streaming-java\target\classes;E:\os_workspace\flink\flink-connectors\flink-file-sink-common\target\classes;E:\os_workspace\flink\flink-runtime\target\classes;E:\os_workspace\flink\flink-queryable-state\flink-queryable-state-client-java\target\classes;E:\os_workspace\flink\flink-filesystems\flink-hadoop-fs\target\classes;D:\eclipse_boot\repository-maven\repository-maven\commons-io\commons-io\2.7\commons-io-2.7.jar;D:\eclipse_boot\repository-maven\repository-maven\org\apache\flink\flink-shaded-netty\4.1.49.Final-12.0\flink-shaded-netty-4.1.49.Final-12.0.jar;D:\eclipse_boot\repository-maven\repository-maven\org\apache\flink\flink-shaded-zookeeper-3\3.4.14-12.0\flink-shaded-zookeeper-3-3.4.14-12.0.jar;D:\eclipse_boot\repository-maven\repository-maven\org\javassist\javassist\3.24.0-GA\javassist-3.24.0-GA.jar;D:\eclipse_boot\repository-maven\repository-maven\com\typesafe\akka\akka-actor_2.11\2.5.21\akka-actor_2.11-2.5.21.jar;D:\eclipse_boot\repository-maven\repository-maven\com\typesafe\config\1.3.0\config-1.3.0.jar;D:\eclipse_boot\repository-maven\repository-maven\org\scala-lang\modules\scala-java8-compat_2.11\0.7.0\scala-java8-compat_2.11-0.7.0.jar;D:\eclipse_boot\repository-maven\repository-maven\com\typesafe\akka\akka-remote_2.11\2.5.21\akka-remote_2.11-2.5.21.jar;D:\eclipse_boot\repository-maven\repository-maven\com\typesafe\akka\akka-stream_2.11\2.5.21\akka-stream_2.11-2.5.21.jar;D:\eclipse_boot\repository-maven\repository-maven\org\reactivestreams\reactive-streams\1.0.2\reactive-streams-1.0.2.jar;D:\eclipse_boot\repository-maven\repository-maven\com\typesafe\ssl-config-core_2.11\0.3.7\ssl-config-core_2.11-0.3.7.jar;D:\eclipse_boot\repository-maven\repository-maven\com\typesafe\akka\akka-protobuf_2.11\2.5.21\akka-protobuf_2.11-2.5.21.jar;D:\eclipse_boot\repository-maven\repository-maven\com\typesafe\akka\akka-slf4j_2.11\2.5.21\akka-slf4j_2.11-2.5.21.jar;D:\eclipse_boot\repository-maven\repository-maven\org\clapper\grizzled-slf4j_2.11\1.3.2\grizzled-slf4j_2.11-1.3.2.jar;D:\eclipse_boot\repository-maven\repository-maven\com\github\scopt\scopt_2.11\3.5.0\scopt_2.11-3.5.0.jar;D:\eclipse_boot\repository-maven\repository-maven\org\xerial\snappy\snappy-java\1.1.4\snappy-java-1.1.4.jar;D:\eclipse_boot\repository-maven\repository-maven\com\twitter\chill_2.11\0.7.6\chill_2.11-0.7.6.jar;D:\eclipse_boot\repository-maven\repository-maven\com\twitter\chill-java\0.7.6\chill-java-0.7.6.jar;D:\eclipse_boot\repository-maven\repository-maven\org\lz4\lz4-java\1.6.0\lz4-java-1.6.0.jar;E:\os_workspace\flink\flink-java\target\classes;D:\eclipse_boot\repository-maven\repository-maven\org\apache\flink\flink-shaded-guava\18.0-12.0\flink-shaded-guava-18.0-12.0.jar;D:\eclipse_boot\repository-maven\repository-maven\org\apache\commons\commons-math3\3.5\commons-math3-3.5.jar;E:\os_workspace\flink\flink-streaming-scala\target\classes;E:\os_workspace\flink\flink-scala\target\classes;D:\eclipse_boot\repository-maven\repository-maven\org\scala-lang\scala-reflect\2.11.12\scala-reflect-2.11.12.jar;D:\eclipse_boot\repository-maven\repository-maven\org\scala-lang\scala-library\2.11.12\scala-library-2.11.12.jar;D:\eclipse_boot\repository-maven\repository-maven\org\scala-lang\scala-compiler\2.11.12\scala-compiler-2.11.12.jar;D:\eclipse_boot\repository-maven\repository-maven\org\scala-lang\modules\scala-xml_2.11\1.0.5\scala-xml_2.11-1.0.5.jar;D:\eclipse_boot\repository-maven\repository-maven\org\scala-lang\modules\scala-parser-combinators_2.11\1.1.1\scala-parser-combinators_2.11-1.1.1.jar;E:\os_workspace\flink\flink-clients\target\classes;E:\os_workspace\flink\flink-optimizer\target\classes;D:\eclipse_boot\repository-maven\repository-maven\commons-cli\commons-cli\1.3.1\commons-cli-1.3.1.jar;E:\os_workspace\flink\flink-connectors\flink-connector-twitter\target\classes;D:\eclipse_boot\repository-maven\repository-maven\com\twitter\hbc-core\2.2.0\hbc-core-2.2.0.jar;D:\eclipse_boot\repository-maven\repository-maven\org\apache\httpcomponents\httpclient\4.5.3\httpclient-4.5.3.jar;D:\eclipse_boot\repository-maven\repository-maven\org\apache\httpcomponents\httpcore\4.4.6\httpcore-4.4.6.jar;D:\eclipse_boot\repository-maven\repository-maven\commons-logging\commons-logging\1.1.3\commons-logging-1.1.3.jar;D:\eclipse_boot\repository-maven\repository-maven\commons-codec\commons-codec\1.13\commons-codec-1.13.jar;D:\eclipse_boot\repository-maven\repository-maven\com\google\guava\guava\14.0.1\guava-14.0.1.jar;D:\eclipse_boot\repository-maven\repository-maven\com\twitter\joauth\6.0.2\joauth-6.0.2.jar;E:\os_workspace\flink\flink-connectors\flink-connector-kafka\target\classes;D:\eclipse_boot\repository-maven\repository-maven\org\apache\kafka\kafka-clients\2.4.1\kafka-clients-2.4.1.jar;D:\eclipse_boot\repository-maven\repository-maven\com\github\luben\zstd-jni\1.4.3-1\zstd-jni-1.4.3-1.jar;E:\os_workspace\flink\flink-connectors\flink-connector-base\target\classes;D:\eclipse_boot\repository-maven\repository-maven\org\apache\flink\flink-shaded-jackson\2.10.1-12.0\flink-shaded-jackson-2.10.1-12.0.jar;D:\eclipse_boot\repository-maven\repository-maven\io\netty\netty\3.10.6.Final\netty-3.10.6.Final.jar;E:\os_workspace\flink\flink-state-backends\flink-statebackend-rocksdb\target\classes;D:\eclipse_boot\repository-maven\repository-maven\com\data-artisans\frocksdbjni\5.17.2-artisans-2.0\frocksdbjni-5.17.2-artisans-2.0.jar;D:\eclipse_boot\repository-maven\repository-maven\org\jcuda\jcuda\10.0.0\jcuda-10.0.0.jar;D:\eclipse_boot\repository-maven\repository-maven\org\jcuda\jcublas\10.0.0\jcublas-10.0.0.jar;E:\os_workspace\flink\flink-core\target\classes;E:\os_workspace\flink\flink-annotations\target\classes;E:\os_workspace\flink\flink-metrics\flink-metrics-core\target\classes;D:\eclipse_boot\repository-maven\repository-maven\org\apache\flink\flink-shaded-asm-7\7.1-12.0\flink-shaded-asm-7-7.1-12.0.jar;D:\eclipse_boot\repository-maven\repository-maven\org\apache\commons\commons-lang3\3.3.2\commons-lang3-3.3.2.jar;D:\eclipse_boot\repository-maven\repository-maven\com\esotericsoftware\kryo\kryo\2.24.0\kryo-2.24.0.jar;D:\eclipse_boot\repository-maven\repository-maven\com\esotericsoftware\minlog\minlog\1.2\minlog-1.2.jar;D:\eclipse_boot\repository-maven\repository-maven\commons-collections\commons-collections\3.2.2\commons-collections-3.2.2.jar;D:\eclipse_boot\repository-maven\repository-maven\org\apache\commons\commons-compress\1.20\commons-compress-1.20.jar;D:\eclipse_boot\repository-maven\repository-maven\org\apache\logging\log4j\log4j-slf4j-impl\2.12.1\log4j-slf4j-impl-2.12.1.jar;D:\eclipse_boot\repository-maven\repository-maven\org\apache\logging\log4j\log4j-api\2.12.1\log4j-api-2.12.1.jar;D:\eclipse_boot\repository-maven\repository-maven\org\apache\logging\log4j\log4j-core\2.12.1\log4j-core-2.12.1.jar;E:\os_workspace\flink\tools\force-shading\target\classes;D:\eclipse_boot\repository-maven\repository-maven\org\slf4j\slf4j-api\1.7.15\slf4j-api-1.7.15.jar;D:\eclipse_boot\repository-maven\repository-maven\com\google\code\findbugs\jsr305\1.3.9\jsr305-1.3.9.jar;D:\eclipse_boot\repository-maven\repository-maven\org\objenesis\objenesis\2.1\objenesis-2.1.jar org.apache.flink.streaming.scala.examples.wordcount.WordCount
Executing WordCount example with default inputs data set.
Use --input to specify file input.
Printing result to stdout. Use --output to specify output path.
2021-09-27 20:18:52,335 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
2021-09-27 20:18:52,347 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
2021-09-27 20:18:52,347 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
2021-09-27 20:18:52,351 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option taskmanager.memory.network.min required for local execution is not set, setting it to its default value 64 mb.
2021-09-27 20:18:52,351 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option taskmanager.memory.network.max required for local execution is not set, setting it to its default value 64 mb.
2021-09-27 20:18:52,352 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The configuration option taskmanager.memory.managed.size required for local execution is not set, setting it to its default value 128 mb.
2021-09-27 20:18:52,362 INFO  org.apache.flink.runtime.minicluster.MiniCluster             [] - Starting Flink Mini Cluster
2021-09-27 20:18:52,374 INFO  org.apache.flink.runtime.minicluster.MiniCluster             [] - Starting Metrics Registry
2021-09-27 20:18:52,493 INFO  org.apache.flink.runtime.metrics.MetricRegistryImpl          [] - No metrics reporter configured, no metrics will be exposed/reported.
2021-09-27 20:18:52,493 INFO  org.apache.flink.runtime.minicluster.MiniCluster             [] - Starting RPC Service(s)
2021-09-27 20:18:52,541 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Trying to start local actor system
2021-09-27 20:18:53,224 INFO  akka.event.slf4j.Slf4jLogger                                 [] - Slf4jLogger started
2021-09-27 20:18:53,511 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Actor system started at akka://flink
2021-09-27 20:18:53,540 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Trying to start local actor system
2021-09-27 20:18:53,565 INFO  akka.event.slf4j.Slf4jLogger                                 [] - Slf4jLogger started
2021-09-27 20:18:53,629 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Actor system started at akka://flink-metrics
2021-09-27 20:18:53,671 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService .
2021-09-27 20:18:53,722 INFO  org.apache.flink.runtime.minicluster.MiniCluster             [] - Starting high-availability services
2021-09-27 20:18:53,758 INFO  org.apache.flink.runtime.blob.BlobServer                     [] - Created BLOB server storage directory C:\Users\my\AppData\Local\Temp\blobStore-1d169db4-3046-4e75-9598-9d98705f0dc7
2021-09-27 20:18:53,784 INFO  org.apache.flink.runtime.blob.BlobServer                     [] - Started BLOB server at 0.0.0.0:59233 - max concurrent requests: 50 - max backlog: 1000
2021-09-27 20:18:53,795 INFO  org.apache.flink.runtime.blob.PermanentBlobCache             [] - Created BLOB cache storage directory C:\Users\my\AppData\Local\Temp\blobStore-e3cc8f0e-9152-47b9-98f0-e7ce09b469a5
2021-09-27 20:18:53,817 INFO  org.apache.flink.runtime.blob.TransientBlobCache             [] - Created BLOB cache storage directory C:\Users\my\AppData\Local\Temp\blobStore-febc9bfd-2937-48bc-b144-02d082819f9e
2021-09-27 20:18:53,819 INFO  org.apache.flink.runtime.minicluster.MiniCluster             [] - Starting 1 TaskManger(s)
2021-09-27 20:18:53,827 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerRunner      [] - Starting TaskManager with ResourceID: b975be99-d014-4a81-8dfc-4d58902928c6
2021-09-27 20:18:53,885 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerServices    [] - Temporary file directory 'C:\Users\my\AppData\Local\Temp': total 60 GB, usable 11 GB (18.33% usable)
2021-09-27 20:18:53,896 INFO  org.apache.flink.runtime.io.disk.FileChannelManagerImpl      [] - FileChannelManager uses directory C:\Users\my\AppData\Local\Temp\flink-io-a63ea32f-88ba-4711-a824-dff0178aa6ba for spill files.
2021-09-27 20:18:53,912 INFO  org.apache.flink.runtime.io.disk.FileChannelManagerImpl      [] - FileChannelManager uses directory C:\Users\my\AppData\Local\Temp\flink-netty-shuffle-35bb8d57-1121-4813-8a53-8f2cdbba7a5e for spill files.
2021-09-27 20:18:53,991 INFO  org.apache.flink.runtime.io.network.buffer.NetworkBufferPool [] - Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
2021-09-27 20:18:54,024 INFO  org.apache.flink.runtime.io.network.NettyShuffleEnvironment  [] - Starting the network environment and its components.
2021-09-27 20:18:54,027 INFO  org.apache.flink.runtime.taskexecutor.KvStateService         [] - Starting the kvState service and its components.
2021-09-27 20:18:54,077 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/rpc/taskmanager_0 .
2021-09-27 20:18:54,103 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Start job leader service.
2021-09-27 20:18:54,130 INFO  org.apache.flink.runtime.filecache.FileCache                 [] - User file cache uses directory C:\Users\my\AppData\Local\Temp\flink-dist-cache-012f2cb7-e2b3-40e8-b894-91612bafbdaf
2021-09-27 20:18:54,187 INFO  org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint   [] - Starting rest endpoint.
2021-09-27 20:18:54,192 INFO  org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint   [] - Failed to load web based job submission extension. Probable reason: flink-runtime-web is not in the classpath.
2021-09-27 20:18:54,710 WARN  org.apache.flink.runtime.webmonitor.WebMonitorUtils          [] - Log file environment variable 'log.file' is not set.
2021-09-27 20:18:54,710 WARN  org.apache.flink.runtime.webmonitor.WebMonitorUtils          [] - JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
2021-09-27 20:18:55,390 INFO  org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint   [] - Rest endpoint listening at localhost:59252
2021-09-27 20:18:55,391 INFO  org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService [] - Proposing leadership to contender http://localhost:59252
2021-09-27 20:18:55,398 INFO  org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint   [] - http://localhost:59252 was granted leadership with leaderSessionID=083cc8a0-49ba-4763-8d20-a8c4d13d200e
2021-09-27 20:18:55,399 INFO  org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService [] - Received confirmation of leadership for leader http://localhost:59252 , session=083cc8a0-49ba-4763-8d20-a8c4d13d200e
2021-09-27 20:18:55,441 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/rpc/resourcemanager_1 .
2021-09-27 20:18:55,467 INFO  org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService [] - Proposing leadership to contender LeaderContender: DefaultDispatcherRunner
2021-09-27 20:18:55,474 INFO  org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - DefaultDispatcherRunner was granted leadership with leader id 0ad980b3-ff41-441b-a51e-eafb4c32ecdd. Creating new DispatcherLeaderProcess.
2021-09-27 20:18:55,511 INFO  org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Start SessionDispatcherLeaderProcess.
2021-09-27 20:18:55,515 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Starting the resource manager.
2021-09-27 20:18:55,515 INFO  org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService [] - Proposing leadership to contender LeaderContender: StandaloneResourceManager
2021-09-27 20:18:55,520 INFO  org.apache.flink.runtime.minicluster.MiniCluster             [] - Flink Mini Cluster started successfully
2021-09-27 20:18:55,526 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - ResourceManager akka://flink/user/rpc/resourcemanager_1 was granted leadership with fencing token 9e2c7b196dc36f7579eec22bfcfd4e46
2021-09-27 20:18:55,528 INFO  org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Recover all persisted job graphs.
2021-09-27 20:18:55,534 INFO  org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Successfully recovered 0 persisted job graphs.
2021-09-27 20:18:55,545 INFO  org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService [] - Received confirmation of leadership for leader akka://flink/user/rpc/resourcemanager_1 , session=79eec22b-fcfd-4e46-9e2c-7b196dc36f75
2021-09-27 20:18:55,550 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Connecting to ResourceManager akka://flink/user/rpc/resourcemanager_1(9e2c7b196dc36f7579eec22bfcfd4e46).
2021-09-27 20:18:55,556 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_2 .
2021-09-27 20:18:55,569 INFO  org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService [] - Received confirmation of leadership for leader akka://flink/user/rpc/dispatcher_2 , session=0ad980b3-ff41-441b-a51e-eafb4c32ecdd
2021-09-27 20:18:55,596 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Resolved ResourceManager address, beginning registration
2021-09-27 20:18:55,609 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering TaskManager with ResourceID b975be99-d014-4a81-8dfc-4d58902928c6 (akka://flink/user/rpc/taskmanager_0) at ResourceManager
2021-09-27 20:18:55,614 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Successful registration at resource manager akka://flink/user/rpc/resourcemanager_1 under registration id f89e44c884f54887158d9d3a77dbe505.
2021-09-27 20:18:55,632 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Received JobGraph submission 3224db4a2c644bb378d49bc019a8f584 (Streaming WordCount).
2021-09-27 20:18:55,633 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Submitting job 3224db4a2c644bb378d49bc019a8f584 (Streaming WordCount).
2021-09-27 20:18:55,673 INFO  org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService [] - Proposing leadership to contender LeaderContender: JobMasterServiceLeadershipRunner
2021-09-27 20:18:55,707 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_3 .
2021-09-27 20:18:55,721 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Initializing job Streaming WordCount (3224db4a2c644bb378d49bc019a8f584).
2021-09-27 20:18:55,764 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Using restart back off time strategy NoRestartBackoffTimeStrategy for Streaming WordCount (3224db4a2c644bb378d49bc019a8f584).
2021-09-27 20:18:55,886 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Running initialization on master for job Streaming WordCount (3224db4a2c644bb378d49bc019a8f584).
2021-09-27 20:18:55,886 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Successfully ran initialization on master in 0 ms.
2021-09-27 20:18:55,933 INFO  org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 pipelined regions in 5 ms
2021-09-27 20:18:55,952 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@56c25a27
2021-09-27 20:18:55,954 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Checkpoint storage is set to 'jobmanager'
2021-09-27 20:18:55,982 INFO  org.apache.flink.runtime.checkpoint.CheckpointCoordinator    [] - No checkpoint found during restore.
2021-09-27 20:18:55,992 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@142ffdbe for Streaming WordCount (3224db4a2c644bb378d49bc019a8f584).
2021-09-27 20:18:56,006 INFO  org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService [] - Received confirmation of leadership for leader akka://flink/user/rpc/jobmanager_3 , session=eb45b136-a56a-4046-bd2d-ffe9d77424bf
2021-09-27 20:18:56,011 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Starting execution of job Streaming WordCount (3224db4a2c644bb378d49bc019a8f584) under job master id bd2dffe9d77424bfeb45b136a56a4046.
2021-09-27 20:18:56,012 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
2021-09-27 20:18:56,013 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Job Streaming WordCount (3224db4a2c644bb378d49bc019a8f584) switched from state CREATED to RUNNING.
2021-09-27 20:18:56,019 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: Collection Source (1/1) (fd844f72cf721fcdf1acd1c1cb7f40bd) switched from CREATED to SCHEDULED.
2021-09-27 20:18:56,019 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (1/4) (68acd85b3ce3e37576fb409e24bf8470) switched from CREATED to SCHEDULED.
2021-09-27 20:18:56,020 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (2/4) (89607905c22c4b29a8ee24229c6dcd8e) switched from CREATED to SCHEDULED.
2021-09-27 20:18:56,020 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (3/4) (6fca72c3646e0cc39359de7e316ca130) switched from CREATED to SCHEDULED.
2021-09-27 20:18:56,020 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (4/4) (ba423611fbfc4f25eb220f23b31f5291) switched from CREATED to SCHEDULED.
2021-09-27 20:18:56,020 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (1/4) (279c3d65ca03e7b1136ef5375bbabf9a) switched from CREATED to SCHEDULED.
2021-09-27 20:18:56,020 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (2/4) (0567502bb2867affaaec142d3b0cc2b8) switched from CREATED to SCHEDULED.
2021-09-27 20:18:56,020 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (3/4) (9e8c720b921a74c9b439feb36d686df5) switched from CREATED to SCHEDULED.
2021-09-27 20:18:56,021 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (4/4) (a968026e369e0b2a5af76bcddeb26346) switched from CREATED to SCHEDULED.
2021-09-27 20:18:56,049 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Connecting to ResourceManager akka://flink/user/rpc/resourcemanager_1(9e2c7b196dc36f7579eec22bfcfd4e46)
2021-09-27 20:18:56,052 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Resolved ResourceManager address, beginning registration
2021-09-27 20:18:56,054 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering job manager bd2dffe9d77424bfeb45b136a56a4046@akka://flink/user/rpc/jobmanager_3 for job 3224db4a2c644bb378d49bc019a8f584.
2021-09-27 20:18:56,060 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registered job manager bd2dffe9d77424bfeb45b136a56a4046@akka://flink/user/rpc/jobmanager_3 for job 3224db4a2c644bb378d49bc019a8f584.
2021-09-27 20:18:56,071 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - JobManager successfully registered at ResourceManager, leader id: 9e2c7b196dc36f7579eec22bfcfd4e46.
2021-09-27 20:18:56,075 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job 3224db4a2c644bb378d49bc019a8f584: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=4}]
2021-09-27 20:18:56,083 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Receive slot request c55f380f676b627c0048eaed93199081 for job 3224db4a2c644bb378d49bc019a8f584 from resource manager with leader id 9e2c7b196dc36f7579eec22bfcfd4e46.
2021-09-27 20:18:56,093 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Allocated slot for c55f380f676b627c0048eaed93199081.
2021-09-27 20:18:56,095 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Add job 3224db4a2c644bb378d49bc019a8f584 for job leader monitoring.
2021-09-27 20:18:56,097 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Try to register at job manager akka://flink/user/rpc/jobmanager_3 with leader id eb45b136-a56a-4046-bd2d-ffe9d77424bf.
2021-09-27 20:18:56,098 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Receive slot request 5303a28c2ec86bec55c73eb52180993b for job 3224db4a2c644bb378d49bc019a8f584 from resource manager with leader id 9e2c7b196dc36f7579eec22bfcfd4e46.
2021-09-27 20:18:56,099 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Allocated slot for 5303a28c2ec86bec55c73eb52180993b.
2021-09-27 20:18:56,099 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Receive slot request 8b386df49d1fbeaeba69a925e7ee2a29 for job 3224db4a2c644bb378d49bc019a8f584 from resource manager with leader id 9e2c7b196dc36f7579eec22bfcfd4e46.
2021-09-27 20:18:56,099 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Allocated slot for 8b386df49d1fbeaeba69a925e7ee2a29.
2021-09-27 20:18:56,099 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Receive slot request 3571fd9a9ca6e44010e78e08e991f974 for job 3224db4a2c644bb378d49bc019a8f584 from resource manager with leader id 9e2c7b196dc36f7579eec22bfcfd4e46.
2021-09-27 20:18:56,099 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Allocated slot for 3571fd9a9ca6e44010e78e08e991f974.
2021-09-27 20:18:56,106 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Resolved JobManager address, beginning registration
2021-09-27 20:18:56,131 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Successful registration at job manager akka://flink/user/rpc/jobmanager_3 for job 3224db4a2c644bb378d49bc019a8f584.
2021-09-27 20:18:56,133 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Establish JobManager connection for job 3224db4a2c644bb378d49bc019a8f584.
2021-09-27 20:18:56,142 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Offer reserved slots to the leader of job 3224db4a2c644bb378d49bc019a8f584.
2021-09-27 20:18:56,165 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: Collection Source (1/1) (fd844f72cf721fcdf1acd1c1cb7f40bd) switched from SCHEDULED to DEPLOYING.
2021-09-27 20:18:56,166 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Source: Collection Source (1/1) (attempt #0) with attempt id fd844f72cf721fcdf1acd1c1cb7f40bd to b975be99-d014-4a81-8dfc-4d58902928c6 @ 127.0.0.1 (dataPort=-1) with allocation id 3571fd9a9ca6e44010e78e08e991f974
2021-09-27 20:18:56,172 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (1/4) (68acd85b3ce3e37576fb409e24bf8470) switched from SCHEDULED to DEPLOYING.
2021-09-27 20:18:56,173 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Flat Map -> Filter -> Map (1/4) (attempt #0) with attempt id 68acd85b3ce3e37576fb409e24bf8470 to b975be99-d014-4a81-8dfc-4d58902928c6 @ 127.0.0.1 (dataPort=-1) with allocation id 3571fd9a9ca6e44010e78e08e991f974
2021-09-27 20:18:56,181 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (2/4) (89607905c22c4b29a8ee24229c6dcd8e) switched from SCHEDULED to DEPLOYING.
2021-09-27 20:18:56,181 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Flat Map -> Filter -> Map (2/4) (attempt #0) with attempt id 89607905c22c4b29a8ee24229c6dcd8e to b975be99-d014-4a81-8dfc-4d58902928c6 @ 127.0.0.1 (dataPort=-1) with allocation id 8b386df49d1fbeaeba69a925e7ee2a29
2021-09-27 20:18:56,181 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (3/4) (6fca72c3646e0cc39359de7e316ca130) switched from SCHEDULED to DEPLOYING.
2021-09-27 20:18:56,181 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Flat Map -> Filter -> Map (3/4) (attempt #0) with attempt id 6fca72c3646e0cc39359de7e316ca130 to b975be99-d014-4a81-8dfc-4d58902928c6 @ 127.0.0.1 (dataPort=-1) with allocation id 5303a28c2ec86bec55c73eb52180993b
2021-09-27 20:18:56,181 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (4/4) (ba423611fbfc4f25eb220f23b31f5291) switched from SCHEDULED to DEPLOYING.
2021-09-27 20:18:56,181 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Flat Map -> Filter -> Map (4/4) (attempt #0) with attempt id ba423611fbfc4f25eb220f23b31f5291 to b975be99-d014-4a81-8dfc-4d58902928c6 @ 127.0.0.1 (dataPort=-1) with allocation id c55f380f676b627c0048eaed93199081
2021-09-27 20:18:56,182 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (1/4) (279c3d65ca03e7b1136ef5375bbabf9a) switched from SCHEDULED to DEPLOYING.
2021-09-27 20:18:56,182 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Keyed Aggregation -> Sink: Print to Std. Out (1/4) (attempt #0) with attempt id 279c3d65ca03e7b1136ef5375bbabf9a to b975be99-d014-4a81-8dfc-4d58902928c6 @ 127.0.0.1 (dataPort=-1) with allocation id 3571fd9a9ca6e44010e78e08e991f974
2021-09-27 20:18:56,183 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 3571fd9a9ca6e44010e78e08e991f974.
2021-09-27 20:18:56,185 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (2/4) (0567502bb2867affaaec142d3b0cc2b8) switched from SCHEDULED to DEPLOYING.
2021-09-27 20:18:56,185 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Keyed Aggregation -> Sink: Print to Std. Out (2/4) (attempt #0) with attempt id 0567502bb2867affaaec142d3b0cc2b8 to b975be99-d014-4a81-8dfc-4d58902928c6 @ 127.0.0.1 (dataPort=-1) with allocation id 8b386df49d1fbeaeba69a925e7ee2a29
2021-09-27 20:18:56,186 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (3/4) (9e8c720b921a74c9b439feb36d686df5) switched from SCHEDULED to DEPLOYING.
2021-09-27 20:18:56,186 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Keyed Aggregation -> Sink: Print to Std. Out (3/4) (attempt #0) with attempt id 9e8c720b921a74c9b439feb36d686df5 to b975be99-d014-4a81-8dfc-4d58902928c6 @ 127.0.0.1 (dataPort=-1) with allocation id 5303a28c2ec86bec55c73eb52180993b
2021-09-27 20:18:56,186 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (4/4) (a968026e369e0b2a5af76bcddeb26346) switched from SCHEDULED to DEPLOYING.
2021-09-27 20:18:56,186 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Keyed Aggregation -> Sink: Print to Std. Out (4/4) (attempt #0) with attempt id a968026e369e0b2a5af76bcddeb26346 to b975be99-d014-4a81-8dfc-4d58902928c6 @ 127.0.0.1 (dataPort=-1) with allocation id c55f380f676b627c0048eaed93199081
2021-09-27 20:18:56,252 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Source: Collection Source (1/1)#0 (fd844f72cf721fcdf1acd1c1cb7f40bd), deploy into slot with allocation id 3571fd9a9ca6e44010e78e08e991f974.
2021-09-27 20:18:56,254 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: Collection Source (1/1)#0 (fd844f72cf721fcdf1acd1c1cb7f40bd) switched from CREATED to DEPLOYING.
2021-09-27 20:18:56,258 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 3571fd9a9ca6e44010e78e08e991f974.
2021-09-27 20:18:56,270 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Source: Collection Source (1/1)#0 (fd844f72cf721fcdf1acd1c1cb7f40bd) [DEPLOYING].
2021-09-27 20:18:56,289 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Flat Map -> Filter -> Map (1/4)#0 (68acd85b3ce3e37576fb409e24bf8470), deploy into slot with allocation id 3571fd9a9ca6e44010e78e08e991f974.
2021-09-27 20:18:56,298 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 8b386df49d1fbeaeba69a925e7ee2a29.
2021-09-27 20:18:56,308 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (1/4)#0 (68acd85b3ce3e37576fb409e24bf8470) switched from CREATED to DEPLOYING.
2021-09-27 20:18:56,309 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Flat Map -> Filter -> Map (1/4)#0 (68acd85b3ce3e37576fb409e24bf8470) [DEPLOYING].
2021-09-27 20:18:56,328 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Flat Map -> Filter -> Map (2/4)#0 (89607905c22c4b29a8ee24229c6dcd8e), deploy into slot with allocation id 8b386df49d1fbeaeba69a925e7ee2a29.
2021-09-27 20:18:56,334 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 5303a28c2ec86bec55c73eb52180993b.
2021-09-27 20:18:56,341 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (2/4)#0 (89607905c22c4b29a8ee24229c6dcd8e) switched from CREATED to DEPLOYING.
2021-09-27 20:18:56,341 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Flat Map -> Filter -> Map (2/4)#0 (89607905c22c4b29a8ee24229c6dcd8e) [DEPLOYING].
2021-09-27 20:18:56,354 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Flat Map -> Filter -> Map (3/4)#0 (6fca72c3646e0cc39359de7e316ca130), deploy into slot with allocation id 5303a28c2ec86bec55c73eb52180993b.
2021-09-27 20:18:56,355 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot c55f380f676b627c0048eaed93199081.
2021-09-27 20:18:56,384 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Flat Map -> Filter -> Map (4/4)#0 (ba423611fbfc4f25eb220f23b31f5291), deploy into slot with allocation id c55f380f676b627c0048eaed93199081.
2021-09-27 20:18:56,392 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot c55f380f676b627c0048eaed93199081.
2021-09-27 20:18:56,393 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 5303a28c2ec86bec55c73eb52180993b.
2021-09-27 20:18:56,393 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 8b386df49d1fbeaeba69a925e7ee2a29.
2021-09-27 20:18:56,393 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 3571fd9a9ca6e44010e78e08e991f974.
2021-09-27 20:18:56,393 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 3571fd9a9ca6e44010e78e08e991f974.
2021-09-27 20:18:56,443 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Keyed Aggregation -> Sink: Print to Std. Out (1/4)#0 (279c3d65ca03e7b1136ef5375bbabf9a), deploy into slot with allocation id 3571fd9a9ca6e44010e78e08e991f974.
2021-09-27 20:18:56,444 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (3/4)#0 (6fca72c3646e0cc39359de7e316ca130) switched from CREATED to DEPLOYING.
2021-09-27 20:18:56,447 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Flat Map -> Filter -> Map (3/4)#0 (6fca72c3646e0cc39359de7e316ca130) [DEPLOYING].
2021-09-27 20:18:56,453 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (4/4)#0 (ba423611fbfc4f25eb220f23b31f5291) switched from CREATED to DEPLOYING.
2021-09-27 20:18:56,453 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Flat Map -> Filter -> Map (4/4)#0 (ba423611fbfc4f25eb220f23b31f5291) [DEPLOYING].
2021-09-27 20:18:56,456 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 8b386df49d1fbeaeba69a925e7ee2a29.
2021-09-27 20:18:56,464 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Keyed Aggregation -> Sink: Print to Std. Out (2/4)#0 (0567502bb2867affaaec142d3b0cc2b8), deploy into slot with allocation id 8b386df49d1fbeaeba69a925e7ee2a29.
2021-09-27 20:18:56,465 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 5303a28c2ec86bec55c73eb52180993b.
2021-09-27 20:18:56,461 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (1/4)#0 (279c3d65ca03e7b1136ef5375bbabf9a) switched from CREATED to DEPLOYING.
2021-09-27 20:18:56,469 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Keyed Aggregation -> Sink: Print to Std. Out (1/4)#0 (279c3d65ca03e7b1136ef5375bbabf9a) [DEPLOYING].
2021-09-27 20:18:56,469 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (2/4)#0 (0567502bb2867affaaec142d3b0cc2b8) switched from CREATED to DEPLOYING.
2021-09-27 20:18:56,469 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Keyed Aggregation -> Sink: Print to Std. Out (2/4)#0 (0567502bb2867affaaec142d3b0cc2b8) [DEPLOYING].
2021-09-27 20:18:56,480 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Keyed Aggregation -> Sink: Print to Std. Out (3/4)#0 (9e8c720b921a74c9b439feb36d686df5), deploy into slot with allocation id 5303a28c2ec86bec55c73eb52180993b.
2021-09-27 20:18:56,481 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot c55f380f676b627c0048eaed93199081.
2021-09-27 20:18:56,488 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (3/4)#0 (9e8c720b921a74c9b439feb36d686df5) switched from CREATED to DEPLOYING.
2021-09-27 20:18:56,490 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Keyed Aggregation -> Sink: Print to Std. Out (3/4)#0 (9e8c720b921a74c9b439feb36d686df5) [DEPLOYING].
2021-09-27 20:18:56,495 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@141aa789
2021-09-27 20:18:56,495 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Checkpoint storage is set to 'jobmanager'
2021-09-27 20:18:56,500 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6d05bd8b
2021-09-27 20:18:56,500 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Checkpoint storage is set to 'jobmanager'
2021-09-27 20:18:56,502 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Keyed Aggregation -> Sink: Print to Std. Out (4/4)#0 (a968026e369e0b2a5af76bcddeb26346), deploy into slot with allocation id c55f380f676b627c0048eaed93199081.
2021-09-27 20:18:56,503 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (4/4)#0 (a968026e369e0b2a5af76bcddeb26346) switched from CREATED to DEPLOYING.
2021-09-27 20:18:56,503 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Keyed Aggregation -> Sink: Print to Std. Out (4/4)#0 (a968026e369e0b2a5af76bcddeb26346) [DEPLOYING].
2021-09-27 20:18:56,506 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@6e46964c
2021-09-27 20:18:56,506 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3b4cb973
2021-09-27 20:18:56,506 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Checkpoint storage is set to 'jobmanager'
2021-09-27 20:18:56,506 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@39d5e0f6
2021-09-27 20:18:56,506 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Checkpoint storage is set to 'jobmanager'
2021-09-27 20:18:56,506 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3619a142
2021-09-27 20:18:56,506 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Checkpoint storage is set to 'jobmanager'
2021-09-27 20:18:56,513 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (2/4)#0 (0567502bb2867affaaec142d3b0cc2b8) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,518 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@3e1182f6
2021-09-27 20:18:56,518 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Checkpoint storage is set to 'jobmanager'
2021-09-27 20:18:56,519 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (2/4) (0567502bb2867affaaec142d3b0cc2b8) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,519 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (4/4)#0 (ba423611fbfc4f25eb220f23b31f5291) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,519 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@58a47657
2021-09-27 20:18:56,519 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Checkpoint storage is set to 'jobmanager'
2021-09-27 20:18:56,519 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4dd06340
2021-09-27 20:18:56,520 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (4/4) (ba423611fbfc4f25eb220f23b31f5291) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,520 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Checkpoint storage is set to 'jobmanager'
2021-09-27 20:18:56,520 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (1/4)#0 (68acd85b3ce3e37576fb409e24bf8470) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,520 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (2/4)#0 (89607905c22c4b29a8ee24229c6dcd8e) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,520 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (2/4) (89607905c22c4b29a8ee24229c6dcd8e) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,521 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (1/4) (68acd85b3ce3e37576fb409e24bf8470) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,521 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (3/4)#0 (6fca72c3646e0cc39359de7e316ca130) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,521 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (3/4) (6fca72c3646e0cc39359de7e316ca130) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,521 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Checkpoint storage is set to 'jobmanager'
2021-09-27 20:18:56,522 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (3/4)#0 (9e8c720b921a74c9b439feb36d686df5) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,522 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (3/4) (9e8c720b921a74c9b439feb36d686df5) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,522 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: Collection Source (1/1)#0 (fd844f72cf721fcdf1acd1c1cb7f40bd) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,523 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: Collection Source (1/1) (fd844f72cf721fcdf1acd1c1cb7f40bd) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,523 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (4/4)#0 (a968026e369e0b2a5af76bcddeb26346) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,523 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (4/4) (a968026e369e0b2a5af76bcddeb26346) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,524 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (1/4)#0 (279c3d65ca03e7b1136ef5375bbabf9a) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,524 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (1/4) (279c3d65ca03e7b1136ef5375bbabf9a) switched from DEPLOYING to INITIALIZING.
2021-09-27 20:18:56,771 INFO  org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder [] - Finished to build heap keyed state-backend.
2021-09-27 20:18:56,796 INFO  org.apache.flink.runtime.state.heap.HeapKeyedStateBackend    [] - Initializing heap keyed state backend with stream factory.
2021-09-27 20:18:56,825 INFO  org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder [] - Finished to build heap keyed state-backend.
2021-09-27 20:18:56,825 INFO  org.apache.flink.runtime.state.heap.HeapKeyedStateBackend    [] - Initializing heap keyed state backend with stream factory.
2021-09-27 20:18:56,827 INFO  org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder [] - Finished to build heap keyed state-backend.
2021-09-27 20:18:56,827 INFO  org.apache.flink.runtime.state.heap.HeapKeyedStateBackend    [] - Initializing heap keyed state backend with stream factory.
2021-09-27 20:18:56,827 INFO  org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder [] - Finished to build heap keyed state-backend.
2021-09-27 20:18:56,828 INFO  org.apache.flink.runtime.state.heap.HeapKeyedStateBackend    [] - Initializing heap keyed state backend with stream factory.
2021-09-27 20:18:56,848 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (3/4)#0 (6fca72c3646e0cc39359de7e316ca130) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,848 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (2/4)#0 (89607905c22c4b29a8ee24229c6dcd8e) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,849 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (1/4)#0 (68acd85b3ce3e37576fb409e24bf8470) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,853 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (3/4) (6fca72c3646e0cc39359de7e316ca130) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,855 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (2/4) (89607905c22c4b29a8ee24229c6dcd8e) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,856 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (1/4) (68acd85b3ce3e37576fb409e24bf8470) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,856 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (4/4)#0 (ba423611fbfc4f25eb220f23b31f5291) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,858 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (4/4) (ba423611fbfc4f25eb220f23b31f5291) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,888 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (2/4)#0 (0567502bb2867affaaec142d3b0cc2b8) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,889 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (4/4)#0 (a968026e369e0b2a5af76bcddeb26346) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,889 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (2/4) (0567502bb2867affaaec142d3b0cc2b8) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,889 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (4/4) (a968026e369e0b2a5af76bcddeb26346) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,890 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (3/4)#0 (9e8c720b921a74c9b439feb36d686df5) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,891 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (3/4) (9e8c720b921a74c9b439feb36d686df5) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,894 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (1/4)#0 (279c3d65ca03e7b1136ef5375bbabf9a) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,894 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (1/4) (279c3d65ca03e7b1136ef5375bbabf9a) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,899 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: Collection Source (1/1)#0 (fd844f72cf721fcdf1acd1c1cb7f40bd) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,910 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: Collection Source (1/1) (fd844f72cf721fcdf1acd1c1cb7f40bd) switched from INITIALIZING to RUNNING.
2021-09-27 20:18:56,950 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: Collection Source (1/1)#0 (fd844f72cf721fcdf1acd1c1cb7f40bd) switched from RUNNING to FINISHED.
2021-09-27 20:18:56,950 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Source: Collection Source (1/1)#0 (fd844f72cf721fcdf1acd1c1cb7f40bd).
2021-09-27 20:18:56,954 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Collection Source (1/1)#0 fd844f72cf721fcdf1acd1c1cb7f40bd.
2021-09-27 20:18:56,957 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (4/4)#0 (ba423611fbfc4f25eb220f23b31f5291) switched from RUNNING to FINISHED.
2021-09-27 20:18:56,957 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Flat Map -> Filter -> Map (4/4)#0 (ba423611fbfc4f25eb220f23b31f5291).
2021-09-27 20:18:56,958 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (3/4)#0 (6fca72c3646e0cc39359de7e316ca130) switched from RUNNING to FINISHED.
2021-09-27 20:18:56,958 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Flat Map -> Filter -> Map (3/4)#0 (6fca72c3646e0cc39359de7e316ca130).
2021-09-27 20:18:56,958 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (2/4)#0 (89607905c22c4b29a8ee24229c6dcd8e) switched from RUNNING to FINISHED.
2021-09-27 20:18:56,959 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Flat Map -> Filter -> Map (2/4)#0 (89607905c22c4b29a8ee24229c6dcd8e).
2021-09-27 20:18:56,962 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Flat Map -> Filter -> Map (1/4)#0 (68acd85b3ce3e37576fb409e24bf8470) switched from RUNNING to FINISHED.
2021-09-27 20:18:56,962 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Flat Map -> Filter -> Map (1/4)#0 (68acd85b3ce3e37576fb409e24bf8470).
2> (not,1)
2> (opposing,1)
2> (die,1)
2> (sleep,1)
2> (wish,1)
2021-09-27 20:18:56,970 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state FINISHED to JobManager for task Flat Map -> Filter -> Map (4/4)#0 ba423611fbfc4f25eb220f23b31f5291.
2021-09-27 20:18:56,971 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state FINISHED to JobManager for task Flat Map -> Filter -> Map (1/4)#0 68acd85b3ce3e37576fb409e24bf8470.
2> (die,2)
2021-09-27 20:18:56,972 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state FINISHED to JobManager for task Flat Map -> Filter -> Map (3/4)#0 6fca72c3646e0cc39359de7e316ca130.
2021-09-27 20:18:56,972 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state FINISHED to JobManager for task Flat Map -> Filter -> Map (2/4)#0 89607905c22c4b29a8ee24229c6dcd8e.
2021-09-27 20:18:56,975 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: Collection Source (1/1) (fd844f72cf721fcdf1acd1c1cb7f40bd) switched from RUNNING to FINISHED.
2> (sleep,2)
2> (respect,1)
2> (pangs,1)
2> (these,1)
2> (fardels,1)
2> (traveller,1)
2> (will,1)
2> (name,1)
2> (soft,1)
2> (now,1)
2> (take,1)
2> (sea,1)
2> (troubles,1)
2> (flesh,1)
2> (heir,1)
2> (consummation,1)
2> (man,1)
2> (quietus,1)
2> (from,1)
2> (cowards,1)
2> (all,1)
2> (their,1)
2> (whether,1)
2> (nobler,1)
2> (sleep,3)
2> (say,1)
2> (sleep,4)
2> (makes,1)
2> (makes,2)
2> (those,1)
2> (fortune,1)
2> (heartache,1)
2> (natural,1)
2> (shocks,1)
2> (for,1)
2> (sleep,5)
2> (death,1)
2> (what,1)
2> (come,1)
2> (for,2)
3> (or,1)
2> (scorns,1)
1> (them,1)
2> (merit,1)
3> (to,1)
1> (devoutly,1)
3> (a,1)
1> (pause,1)
2021-09-27 20:18:56,984 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (4/4) (ba423611fbfc4f25eb220f23b31f5291) switched from RUNNING to FINISHED.
2021-09-27 20:18:56,986 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (1/4) (68acd85b3ce3e37576fb409e24bf8470) switched from RUNNING to FINISHED.
2021-09-27 20:18:56,987 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (3/4) (6fca72c3646e0cc39359de7e316ca130) switched from RUNNING to FINISHED.
3> (that,1)
3> (to,2)
3> (tis,1)
3> (a,2)
2021-09-27 20:18:56,988 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Flat Map -> Filter -> Map (2/4) (89607905c22c4b29a8ee24229c6dcd8e) switched from RUNNING to FINISHED.
1> (law,1)
3> (when,1)
4> (arms,1)
3> (coil,1)
4> (against,1)
2> (unworthy,1)
4> (of,1)
4> (is,1)
4> (we,1)
4> (have,1)
4> (off,1)
4> (mortal,1)
4> (oppressor,1)
4> (wrong,1)
4> (proud,1)
4> (contumely,1)
4> (himself,1)
4> (might,1)
4> (country,1)
4> (bourn,1)
4> (thus,1)
4> (does,1)
4> (of,2)
4> (with,1)
4> (regard,1)
4> (awry,1)
4> (is,2)
4> (and,1)
4> (by,1)
4> (end,1)
4> (must,1)
4> (of,3)
4> (despis,1)
4> (with,2)
4> (bodkin,1)
4> (returns,1)
4> (and,2)
4> (thus,2)
4> (native,1)
4> (of,4)
4> (and,3)
4> (of,5)
4> (action,1)
4> (in,1)
4> (mind,1)
4> (more,1)
4> (and,4)
4> (by,2)
4> (we,2)
4> (end,2)
4> (perchance,1)
4> (dream,1)
4> (ay,1)
4> (calamity,1)
4> (of,6)
4> (so,1)
4> (life,1)
4> (insolence,1)
4> (of,7)
4> (and,5)
4> (spurns,1)
4> (grunt,1)
4> (and,6)
4> (under,1)
4> (life,2)
4> (and,7)
4> (rather,1)
4> (ills,1)
4> (we,3)
4> (have,2)
4> (is,3)
4> (sicklied,1)
4> (with,3)
4> (pale,1)
4> (of,8)
4> (thought,1)
4> (fair,1)
4> (in,2)
4> (and,8)
4> (of,9)
4> (outrageous,1)
4> (and,9)
4> (thousand,1)
4> (in,3)
4> (of,10)
4> (and,10)
4> (of,11)
4> (of,12)
4> (takes,1)
4> (but,1)
4> (of,13)
4> (something,1)
4> (than,1)
4> (fly,1)
4> (we,4)
4> (of,14)
4> (and,11)
4> (of,15)
4> (and,12)
4> (sins,1)
4> (remember,1)
2021-09-27 20:18:57,003 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (4/4)#0 (a968026e369e0b2a5af76bcddeb26346) switched from RUNNING to FINISHED.
2021-09-27 20:18:57,003 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Keyed Aggregation -> Sink: Print to Std. Out (4/4)#0 (a968026e369e0b2a5af76bcddeb26346).
3> (the,1)
3> (s,1)
3> (the,2)
3> (s,2)
3> (when,2)
3> (his,1)
3> (make,1)
3> (the,3)
3> (undiscover,1)
3> (d,1)
3> (whose,1)
3> (make,2)
3> (us,1)
3> (currents,1)
3> (turn,1)
3> (to,3)
3> (be,1)
3> (or,2)
3> (to,4)
3> (be,2)
3> (that,2)
3> (the,4)
3> (question,1)
3> (to,5)
3> (to,6)
3> (to,7)
3> (be,3)
3> (d,2)
3> (to,8)
1> (delay,1)
1> (would,1)
1> (resolution,1)
1> (shuffled,1)
1> (this,1)
1> (he,1)
1> (conscience,1)
1> (this,2)
1> (rub,1)
1> (long,1)
1> (office,1)
1> (weary,1)
1> (o,1)
1> (er,1)
1> (orisons,1)
1> (slings,1)
1> (dreams,1)
2> (after,1)
1> (would,2)
1> (patient,1)
1> (others,1)
1> (enterprises,1)
3> (to,9)
3> (give,1)
3> (us,2)
3> (there,1)
3> (s,3)
3> (the,5)
3> (the,6)
3> (d,3)
3> (love,1)
3> (the,7)
3> (s,4)
3> (a,3)
3> (bare,1)
3> (who,1)
3> (bear,1)
3> (no,1)
3> (puzzles,1)
3> (the,8)
3> (the,9)
2021-09-27 20:18:57,007 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state FINISHED to JobManager for task Keyed Aggregation -> Sink: Print to Std. Out (4/4)#0 a968026e369e0b2a5af76bcddeb26346.
2021-09-27 20:18:57,043 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (4/4) (a968026e369e0b2a5af76bcddeb26346) switched from RUNNING to FINISHED.
2> (death,2)
2> (know,1)
2> (not,2)
2> (pith,1)
2> (all,2)
2021-09-27 20:18:57,048 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job 3224db4a2c644bb378d49bc019a8f584: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=3}]
3> (hue,1)
3> (lose,1)
3> (the,10)
3> (you,1)
3> (tis,2)
3> (the,11)
3> (to,10)
3> (suffer,1)
3> (no,2)
3> (a,4)
3> (to,11)
3> (to,12)
3> (to,13)
3> (there,2)
3> (s,5)
2021-09-27 20:18:57,050 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (1/4)#0 (279c3d65ca03e7b1136ef5375bbabf9a) switched from RUNNING to FINISHED.
3> (the,12)
2021-09-27 20:18:57,050 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Keyed Aggregation -> Sink: Print to Std. Out (1/4)#0 (279c3d65ca03e7b1136ef5375bbabf9a).
3> (that,3)
3> (the,13)
3> (the,14)
3> (to,14)
2021-09-27 20:18:57,046 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (2/4)#0 (0567502bb2867affaaec142d3b0cc2b8) switched from RUNNING to FINISHED.
2021-09-27 20:18:57,052 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Keyed Aggregation -> Sink: Print to Std. Out (2/4)#0 (0567502bb2867affaaec142d3b0cc2b8).
2021-09-27 20:18:57,053 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state FINISHED to JobManager for task Keyed Aggregation -> Sink: Print to Std. Out (1/4)#0 279c3d65ca03e7b1136ef5375bbabf9a.
2021-09-27 20:18:57,053 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state FINISHED to JobManager for task Keyed Aggregation -> Sink: Print to Std. Out (2/4)#0 0567502bb2867affaaec142d3b0cc2b8.
2021-09-27 20:18:57,054 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (1/4) (279c3d65ca03e7b1136ef5375bbabf9a) switched from RUNNING to FINISHED.
3> (sweat,1)
3> (a,5)
3> (us,3)
3> (bear,2)
3> (the,15)
3> (cast,1)
3> (the,16)
3> (ophelia,1)
3> (nymph,1)
3> (thy,1)
2021-09-27 20:18:57,056 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (2/4) (0567502bb2867affaaec142d3b0cc2b8) switched from RUNNING to FINISHED.
3> (the,17)
3> (arrows,1)
3> (the,18)
3> (the,19)
3> (that,4)
3> (may,1)
3> (who,2)
3> (bear,3)
3> (the,20)
3> (whips,1)
3> (time,1)
3> (that,5)
3> (the,21)
3> (that,6)
3> (the,22)
3> (dread,1)
3> (to,15)
3> (that,7)
3> (great,1)
3> (moment,1)
3> (be,4)
2021-09-27 20:18:57,057 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job 3224db4a2c644bb378d49bc019a8f584: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}]
2021-09-27 20:18:57,058 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job 3224db4a2c644bb378d49bc019a8f584: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
3> (my,1)
3> (d,4)
2021-09-27 20:18:57,062 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Keyed Aggregation -> Sink: Print to Std. Out (3/4)#0 (9e8c720b921a74c9b439feb36d686df5) switched from RUNNING to FINISHED.
2021-09-27 20:18:57,062 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Freeing task resources for Keyed Aggregation -> Sink: Print to Std. Out (3/4)#0 (9e8c720b921a74c9b439feb36d686df5).
2021-09-27 20:18:57,067 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Un-registering task and sending final execution state FINISHED to JobManager for task Keyed Aggregation -> Sink: Print to Std. Out (3/4)#0 9e8c720b921a74c9b439feb36d686df5.
2021-09-27 20:18:57,069 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Keyed Aggregation -> Sink: Print to Std. Out (3/4) (9e8c720b921a74c9b439feb36d686df5) switched from RUNNING to FINISHED.
2021-09-27 20:18:57,070 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Job Streaming WordCount (3224db4a2c644bb378d49bc019a8f584) switched from state RUNNING to FINISHED.
2021-09-27 20:18:57,070 INFO  org.apache.flink.runtime.checkpoint.CheckpointCoordinator    [] - Stopping checkpoint coordinator for job 3224db4a2c644bb378d49bc019a8f584.
2021-09-27 20:18:57,073 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Clearing resource requirements of job 3224db4a2c644bb378d49bc019a8f584
2021-09-27 20:18:57,075 INFO  org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore [] - Shutting down
2021-09-27 20:18:57,086 INFO  org.apache.flink.runtime.minicluster.MiniCluster             [] - Shutting down Flink Mini Cluster
2021-09-27 20:18:57,087 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Job 3224db4a2c644bb378d49bc019a8f584 reached terminal state FINISHED.
2021-09-27 20:18:57,087 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Stopping TaskExecutor akka://flink/user/rpc/taskmanager_0.
2021-09-27 20:18:57,087 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Close ResourceManager connection 925a9ef56a06f2dcf1345fa6442f41a8.
2021-09-27 20:18:57,088 INFO  org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint   [] - Shutting down rest endpoint.
2021-09-27 20:18:57,093 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Closing TaskExecutor connection b975be99-d014-4a81-8dfc-4d58902928c6 because: The TaskExecutor is shutting down.
2021-09-27 20:18:57,093 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Stopping the JobMaster for job Streaming WordCount(3224db4a2c644bb378d49bc019a8f584).
2021-09-27 20:18:57,099 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Close JobManager connection for job 3224db4a2c644bb378d49bc019a8f584.
2021-09-27 20:18:57,106 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}, allocationId: c55f380f676b627c0048eaed93199081, jobId: 3224db4a2c644bb378d49bc019a8f584).
2021-09-27 20:18:57,109 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:1, state:ALLOCATED, resource profile: ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}, allocationId: 5303a28c2ec86bec55c73eb52180993b, jobId: 3224db4a2c644bb378d49bc019a8f584).
2021-09-27 20:18:57,109 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:2, state:ALLOCATED, resource profile: ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}, allocationId: 8b386df49d1fbeaeba69a925e7ee2a29, jobId: 3224db4a2c644bb378d49bc019a8f584).
2021-09-27 20:18:57,109 INFO  org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool [] - Releasing slot [5303a28c2ec86bec55c73eb52180993b].
2021-09-27 20:18:57,110 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:3, state:ALLOCATED, resource profile: ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes), taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb (33554432 bytes), networkMemory=16.000mb (16777216 bytes)}, allocationId: 3571fd9a9ca6e44010e78e08e991f974, jobId: 3224db4a2c644bb378d49bc019a8f584).
2021-09-27 20:18:57,111 INFO  org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool [] - Releasing slot [8b386df49d1fbeaeba69a925e7ee2a29].
2021-09-27 20:18:57,112 INFO  org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool [] - Releasing slot [3571fd9a9ca6e44010e78e08e991f974].
2021-09-27 20:18:57,113 INFO  org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool [] - Releasing slot [c55f380f676b627c0048eaed93199081].
2021-09-27 20:18:57,114 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Close ResourceManager connection 925a9ef56a06f2dcf1345fa6442f41a8: Stopping JobMaster for job Streaming WordCount(3224db4a2c644bb378d49bc019a8f584)..
2021-09-27 20:18:57,115 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Disconnect job manager bd2dffe9d77424bfeb45b136a56a4046@akka://flink/user/rpc/jobmanager_3 for job 3224db4a2c644bb378d49bc019a8f584 from the resource manager.
2021-09-27 20:18:57,136 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Stop job leader service.
2021-09-27 20:18:57,136 INFO  org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] - Shutting down TaskExecutorLocalStateStoresManager.
2021-09-27 20:18:57,138 INFO  org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint   [] - Removing cache directory C:\Users\my\AppData\Local\Temp\flink-web-ui
2021-09-27 20:18:57,141 INFO  org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint   [] - Shut down complete.
2021-09-27 20:18:57,145 INFO  org.apache.flink.runtime.io.disk.FileChannelManagerImpl      [] - FileChannelManager removed spill file directory C:\Users\my\AppData\Local\Temp\flink-io-a63ea32f-88ba-4711-a824-dff0178aa6ba
2021-09-27 20:18:57,145 INFO  org.apache.flink.runtime.io.network.NettyShuffleEnvironment  [] - Shutting down the network environment and its components.
2021-09-27 20:18:57,146 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
2021-09-27 20:18:57,147 INFO  org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent [] - Closing components.
2021-09-27 20:18:57,148 INFO  org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Stopping SessionDispatcherLeaderProcess.
2021-09-27 20:18:57,150 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
2021-09-27 20:18:57,150 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Closing the slot manager.
2021-09-27 20:18:57,150 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Suspending the slot manager.
2021-09-27 20:18:57,150 INFO  org.apache.flink.runtime.io.disk.FileChannelManagerImpl      [] - FileChannelManager removed spill file directory C:\Users\my\AppData\Local\Temp\flink-netty-shuffle-35bb8d57-1121-4813-8a53-8f2cdbba7a5e
2021-09-27 20:18:57,151 INFO  org.apache.flink.runtime.taskexecutor.KvStateService         [] - Shutting down the kvState service and its components.
2021-09-27 20:18:57,151 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Stop job leader service.
2021-09-27 20:18:57,152 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
2021-09-27 20:18:57,153 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
2021-09-27 20:18:57,154 INFO  org.apache.flink.runtime.filecache.FileCache                 [] - removed file cache directory C:\Users\my\AppData\Local\Temp\flink-dist-cache-012f2cb7-e2b3-40e8-b894-91612bafbdaf
2021-09-27 20:18:57,154 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
2021-09-27 20:18:57,156 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Stopping Akka RPC service.
2021-09-27 20:18:57,205 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Stopping Akka RPC service.
2021-09-27 20:18:57,205 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Stopped Akka RPC service.
2021-09-27 20:18:57,231 INFO  org.apache.flink.runtime.blob.PermanentBlobCache             [] - Shutting down BLOB cache
2021-09-27 20:18:57,234 INFO  org.apache.flink.runtime.blob.TransientBlobCache             [] - Shutting down BLOB cache
2021-09-27 20:18:57,256 INFO  org.apache.flink.runtime.blob.BlobServer                     [] - Stopped BLOB server at 0.0.0.0:59233
2021-09-27 20:18:57,257 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Stopped Akka RPC service.

Process finished with exit code 0

2.debug
运行完后,在指定位置打断点,右键Debug ‘WordCount’

  • 1
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
Flink iceberg环境搭建需要以下几个步骤: 1. 安装Hadoop 首先需要安装Hadoop,并且配置好Hadoop的环境变量和相关配置文件,确保Hadoop能够正常使用。可以参考Hadoop官方文档进行安装和配置。 2. 下载Iceberg jar包 Iceberg是一个开源的数据表格管理库,可以在Hadoop上管理海量数据表。可以在Maven仓库中下载最新的Iceberg jar包,或者从GitHub上下载源码进行编译打包。 3. 配置Flink环境 在Flink环境中,需要配置Iceberg的相关依赖和参数。可以在Flink配置文件中添加以下内容: ``` flink.executor.extraClasspath: /path/to/iceberg.jar flink.sql.catalog.iceberg.type: iceberg flink.sql.catalog.iceberg.factory-class: org.apache.iceberg.flink.IcebergCatalogFactory flink.sql.catalog.iceberg.catalog-type: hadoop flink.sql.catalog.iceberg.warehouse: hdfs://<namenode-host>:<namenode-port>/<warehouse-dir> ``` 其中,`/path/to/iceberg.jar`为Iceberg jar包的路径,`<namenode-host>`和`<namenode-port>`为Hadoop的NameNode地址和端口号,`<warehouse-dir>`为Iceberg表格的存储目录。 4. 创建Iceberg表格 在Flink中,可以使用SQL语句创建Iceberg表格。例如: ``` CREATE TABLE my_table ( id INT, name STRING, age INT ) PARTITIONED BY (gender STRING) WITH ( 'type'='iceberg', 'catalog'='hadoop', 'catalog-namespace'='my_namespace', 'warehouse'='hdfs://<namenode-host>:<namenode-port>/<warehouse-dir>' ) ``` 其中,`my_table`为表格名称,`id`、`name`、`age`和`gender`为表格字段,`catalog-namespace`为Iceberg表格的命名空间。 5. 插入数据 使用Flink的DataStream或Table API插入数据到Iceberg表格中。例如: ``` StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); DataStream<MyData> dataStream = env.fromElements( new MyData(1, "Alice", 20, "female"), new MyData(2, "Bob", 30, "male") ); Table table = ... // get the Iceberg table table.executeInsert(dataStream); ``` 其中,`MyData`为数据类型,`table`为Iceberg表格对象。 通过以上步骤,就可以在Flink中搭建Iceberg环境,并且使用Iceberg管理海量数据表。

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值