Skip to content

Commit 4612212

Browse files
committed
docs
1 parent 3b310ab commit 4612212

File tree

2 files changed

+10
-2
lines changed

2 files changed

+10
-2
lines changed

docs/modules/spark-k8s/pages/usage-guide/overrides.adoc

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -154,4 +154,12 @@ Read the xref:concepts:overrides.adoc#pod-overrides[Pod overrides documentation]
154154
Stackable operators automatically determine the set of needed JVM arguments, such as memory settings or trust- and keystores.
155155
Using JVM argument overrides you can configure the JVM arguments xref:concepts:overrides.adoc#jvm-argument-overrides[according to the concepts page].
156156

157-
TODO more docs
157+
=== Spark application
158+
159+
WARNING: Please note that you can currently not configure the JVM arguments of the spark-submit call, only on the drivers and executors.
160+
161+
The JVM arguments will be passed via `spark.driver.extraJavaOptions` and `spark.executor.extraJavaOptions`.
162+
163+
=== History server
164+
165+
JVM arguments can be configured normally and will be passed via the env variable `SPARK_HISTORY_OPTS`.

rust/operator-binary/src/config/jvm.rs

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ pub enum Error {
2121
}
2222

2323
/// JVM arguments that go into
24-
/// 1.`spark.driver.extraJavaOptions`
24+
/// 1. `spark.driver.extraJavaOptions`
2525
/// 2. `spark.executor.extraJavaOptions`
2626
pub fn construct_extra_java_options(
2727
spark_application: &SparkApplication,

0 commit comments

Comments
 (0)