File tree Expand file tree Collapse file tree 2 files changed +10
-2
lines changed
docs/modules/spark-k8s/pages/usage-guide
rust/operator-binary/src/config Expand file tree Collapse file tree 2 files changed +10
-2
lines changed Original file line number Diff line number Diff line change @@ -154,4 +154,12 @@ Read the xref:concepts:overrides.adoc#pod-overrides[Pod overrides documentation]
154
154
Stackable operators automatically determine the set of needed JVM arguments, such as memory settings or trust- and keystores.
155
155
Using JVM argument overrides you can configure the JVM arguments xref:concepts:overrides.adoc#jvm-argument-overrides[according to the concepts page].
156
156
157
- TODO more docs
157
+ === Spark application
158
+
159
+ WARNING: Please note that you can currently not configure the JVM arguments of the spark-submit call, only on the drivers and executors.
160
+
161
+ The JVM arguments will be passed via `spark.driver.extraJavaOptions` and `spark.executor.extraJavaOptions`.
162
+
163
+ === History server
164
+
165
+ JVM arguments can be configured normally and will be passed via the env variable `SPARK_HISTORY_OPTS`.
Original file line number Diff line number Diff line change @@ -21,7 +21,7 @@ pub enum Error {
21
21
}
22
22
23
23
/// JVM arguments that go into
24
- /// 1.`spark.driver.extraJavaOptions`
24
+ /// 1. `spark.driver.extraJavaOptions`
25
25
/// 2. `spark.executor.extraJavaOptions`
26
26
pub fn construct_extra_java_options (
27
27
spark_application : & SparkApplication ,
You can’t perform that action at this time.
0 commit comments