Flink parallelism/maxParallelism 作用源码

最新推荐文章于 2024-04-22 14:18:48 发布

二十六画生的博客

最新推荐文章于 2024-04-22 14:18:48 发布

阅读量2.2k

点赞数

分类专栏： Flink 文章标签： Flink parallelism maxParallelism 作用源码

本文链接：https://blog.csdn.net/u010002184/article/details/113110912

版权

Flink 专栏收录该内容

68 篇文章 8 订阅 ¥29.90 ¥99.00

订阅专栏

超级会员免费看

本文详细介绍了Flink中并行执行的配置，包括任务的并行度设定及其在操作符、执行环境、客户端和系统级别的不同层次。同时，解释了最大并行度的重要性和如何设置，以及设置过大的影响。提供了相关API的示例和源码链接。

摘要由CSDN通过智能技术生成

Parallel Execution

This section describes how the parallel execution of programs can be configured in Flink. A Flink program consists of multiple tasks (transformations/operators, data sources, and sinks). A task is split into several parallel instances for execution and each parallel instance processes a subset of the task’s input data. The number of parallel instances of a task is called its parallelism.

If you want to use savepoints you should also consider setting a maximum parallelism (or max parallelism).

了解本专栏