Skip to content
This repository was archived by the owner on Feb 16, 2024. It is now read-only.

Commit bc61b82

Browse files
committed
Let lakehouse spark driver wait for executors (#262)
## Description *Please add a description here. This will become the commit message of the merge request later.*
1 parent 877ded3 commit bc61b82

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

demos/data-lakehouse-iceberg-trino-spark/create-spark-ingestion-job.yaml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -134,6 +134,9 @@ data:
134134
subprocess.run("openssl pkcs12 -export -in /stackable/tls/chain.crt -inkey /stackable/tls/tls.key -out /stackable/tls/keystore.p12 --password pass:changeit", shell=True)
135135
# We have to return some value
136136
return partitionData
137+
138+
# We have to wait until executors are ready, otherwise they will join later on and will be missing the /stackable/tls/keystore.p12
139+
time.sleep(5 * 50)
137140
138141
# Run on driver
139142
createTrustStore("dummy")

0 commit comments

Comments
 (0)