Flink savepoint | checkpoint 恢复

胖胖胖胖胖虎

已于 2022-11-27 23:48:38 修改

阅读量674

点赞数

分类专栏： Flink 文章标签： flink 大数据 hadoop

于 2022-11-04 23:19:37 首次发布

本文链接：https://blog.csdn.net/qq_15138049/article/details/127698199

版权

Flink 专栏收录该内容

27 篇文章 0 订阅

订阅专栏

savepoint

手动触发 savepoint

root@flink-jobmanager-0:/opt/flink/bin# ./flink savepoint 0d69ad4b526c7d7e491357bc842b1e75 hdfs://hdfs-namenode-service:9000/flink-savepoints
...
Triggering savepoint for job 0d69ad4b526c7d7e491357bc842b1e75.
Waiting for response...
Savepoint completed. Path: hdfs://hdfs-namenode-service:9000/flink-savepoints/savepoint-0d69ad-e7f300dcf256
You can resume your program from this savepoint with the run command.

flink on yarn savepoint

root@flink-jobmanager-0:/opt/flink/bin# ./flink stop 7c32acbd7c4e79599e0d3e2cddb2a58d -yid application_1659410541398_0026 -p hdfs://hdfs-namenode-service:9000/flink-savepoints

...
Savepoint completed. Path: hdfs://hdfs-namenode-service:9000/flink-savepoints/savepoint-7c32ac-28eaf6dd5e64

savepoint 恢复

./flink/bin/flink run -m yarn-cluster -s hdfs://hdfs-namenode-service:9000/flink-savepoints/savepoint-0d6                      9ad-e7f300dcf256 -c com.nufront.bigdata.v2x.job.V2xRTDataPersistenceToHDFS /opt/v2x-1.0-SNAPSHOT.jar

在这里插入图片描述

checkpoint

checkpoint 恢复

--allowNonRestoredState 程序发生修改
在这里插入图片描述

root@flink-jobmanager-0:/opt# /opt/flink/bin/flink run -m flink-jobmanager:8081 -s hdfs://hdfs-namenode-service:9000//flink-checkpoints/1e403e273864a487c2f6b2436983d0a2/chk-668 --allowNonRestoredState  -c com.nufront.bigdata.v2x.job.V2xRTDataStramSplit2KafkaState /opt/v2x-1.0-SNAPSHOT.jar consumer.test.group.20221115.0002
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/flink/lib/log4j-slf4j-impl-2.16.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/flink/lib/phoenix-5.0.0-HBase-2.0-client.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/flink/lib/phoenix-core-5.0.0-HBase-2.0-jar-with-dependencies-with-hbase-site.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.7.2/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
Job has been submitted with JobID 6cb8b4d4d157472719b85e11efa20083