Skip to content

Commit 91cf911

Browse files
committed
fix(docs): update changelog and add logging.adoc page
1 parent a76d5e1 commit 91cf911

File tree

2 files changed

+9
-2
lines changed

2 files changed

+9
-2
lines changed

CHANGELOG.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -13,8 +13,10 @@ All notable changes to this project will be documented in this file.
1313
- Various documentation of the CRD ([#319]).
1414
- [BREAKING] Removed version field. Several attributes have been changed to mandatory. While this change is
1515
technically breaking, existing Spark jobs would not have worked before as these attributes were necessary ([#319]).
16-
- [BREAKING] Remove `userClassPathFirst` properties from `spark-submit` and all references to the
17-
`/stackable/spark/extra-jars` folder. This PR is paired with the `docker-images` PR #556 which removes that folder. ([#355])
16+
- [BREAKING] Remove `userClassPathFirst` properties from `spark-submit`. This is an experimental feature that was
17+
introduced to support logging in xml format. The side-effect of this removal is that the vector agent cannot
18+
aggregate output from the `spark-submit` containers. On the other side, it enables dynamic provisionining of
19+
delta.io packages (among others) with Stackable stock images which is much more important. ([#355])
1820

1921
### Fixed
2022

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
= Logging
2+
3+
Logs produced by SparkApplications are automatically collected by vector agents and can be aggregated as described in xref:concepts:logging.adoc[roles]
4+
5+
NOTE: Only logs produced by the application's driver and executors are collected. Logs produced by `spark-submit` are discarded.

0 commit comments

Comments
 (0)