Skip to content

Handle stale information/clean up stale resources #146

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
4 tasks
razvan opened this issue Sep 26, 2022 · 1 comment
Closed
4 tasks

Handle stale information/clean up stale resources #146

razvan opened this issue Sep 26, 2022 · 1 comment
Assignees
@razvan

Comments

@razvan
Copy link
Member

razvan commented Sep 26, 2022 •
edited
Loading

Description

UPDATE: the decision was made to close this issue in favor of #155

Part of : stackabletech/issues#203

TODO: investigate what happens with failed and re-submitted applications and update the acceptance criteria.

Open questions

  • When should the Job resource be deleted ? Should the user configure a deletion strategy, for example immediate when successful or after a predefined TTL ?
  • Wait for Implement ADR 22 (Spark history server) #124 before deleting anything?

Acceptance criteria

  • Job ressources created by the operator are cleaned up after a confirable amount of time.
  • The Pod resource used to spark-submit applications is cleaned up after a confirable amount of time.
@razvan razvan mentioned this issue Sep 26, 2022
Closed
1 task
@lfrancke lfrancke moved this to Idea/Proposal in Stackable Engineering Sep 26, 2022
@lfrancke lfrancke moved this from Idea/Proposal to Refinement: Waiting for in Stackable Engineering Sep 27, 2022
@razvan razvan moved this from Refinement: Waiting for to Refinement: In Progress in Stackable Engineering Sep 27, 2022
@razvan razvan moved this from Refinement: In Progress to Refinement Acceptance: Waiting for in Stackable Engineering Sep 28, 2022
@lfrancke lfrancke moved this from Refinement Acceptance: Waiting for to Refinement Acceptance: Done in Stackable Engineering Sep 28, 2022
@lfrancke lfrancke moved this from Refinement Acceptance: Done to Development: Waiting for in Stackable Engineering Oct 4, 2022
@razvan razvan self-assigned this Oct 4, 2022
@razvan razvan moved this from Development: Waiting for to Development: In Progress in Stackable Engineering Oct 4, 2022
@razvan
Copy link
Member Author

razvan commented Oct 7, 2022

Close in favor of #155

@razvan razvan moved this from Development: In Progress to Development: Waiting for Review in Stackable Engineering Oct 7, 2022
@razvan razvan moved this from Development: Waiting for Review to Development: Done in Stackable Engineering Oct 7, 2022
@lfrancke lfrancke closed this as completed Oct 7, 2022
@lfrancke lfrancke moved this from Development: Done to Done in Stackable Engineering Oct 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@razvan razvan

Labels
None yet
Projects
Stackable Engineering
Archived in project
Milestone
No milestone
Development

No branches or pull requests
2 participants
@razvan @lfrancke