flink redis异常

flink项目背压问题

1、redis：flink项目背压问题

1、突然遇到flink执行速度特别慢，一小时才跑了1G数据，于是查看背压状态，发现出现背压。
2、重新执行任务，查看背压算子，发现是redissink 导致，继而报错

Caused by: redis.clients.jedis.exceptions.JedisConnectionException: Could not get a resource from the pool

Caused by: java.util.NoSuchElementException: Unable to validate object
3、再次重启job 已经崩溃，直接报错，数据不能写入
4、由于是测试，直接flushall 发现报错
MISCONF Redis is configured to save RDB snapshots, but it is currently not able to persist on disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.
5、redis 执行命令
config set stop-writes-on-bgsave-error no
6、flushall 成功
7、重启job 背压问题不在出现。

2、redis：flink job 异常

1、报错：
Caused by: redis.clients.jedis.exceptions.JedisException: Could not return the resource to the pool
Caused by: java.lang.IllegalStateException: Invalidated object not currently part of this pool
2、检查代码，是两次关闭连接导致的问题。