java 覆盖jar默认配置_添加配置设置会覆盖所有默认的 spark.executor.extraJavaOptions 设置 - Azure Databricks - Workspace | Mi...

添加配置设置会覆盖所有默认的 spark.executor.extraJavaOptions 设置Adding a configuration setting overwrites all default spark.executor.extraJavaOptions settings

03/10/2020

本文内容

问题Problem

当通过在 Apache“Spark 配置”文本区域中输入配置设置来添加配置设置时，新设置将替换现有设置，而不是进行追加。When you add a configuration setting by entering it in the Apache Spark Config text area, the new setting replaces existing settings instead of being appended.

VersionVersion

Databricks Runtime 5.1 及更低版本。Databricks Runtime 5.1 and below.

原因Cause

当群集重启时，群集将从“群集”UI 中创建的配置文件中读取设置，并覆盖默认设置。When the cluster restarts, the cluster reads settings from a configuration file that is created in the Clusters UI, and overwrites the default settings.

例如，将以下 extraJavaOptions 添加到“Spark 配置”文本区域：For example, when you add the following extraJavaOptions to the Spark Config text area:

spark.executor.extraJavaOptions -<