ws-manager: remove PVC once the workspace pod is unschedulable

[jenting]

Description

Remove PVC once the workspace pod is unschedulable.

Related Issue(s)

Fixes #13282

How to test

Case 1.

• Create 100 pods to reach the per-node max pod limit

  for i in {1..100}; do kubectl run test-${i} --image ubuntu -- sleep 3600; done

• Enable PVC feature flag.
• Create a workspace, and make sure the workspace pod fails to up.
  • Waits for 10 minutes: the workspace pod finalizer is removed, and the PVC object is gone.
  • Waits for 30 minutes: the workspace pod is deleted.

Release Notes

None

Documentation

None

Werft options:

• /werft with-local-preview
  If enabled this will build install/preview
• /werft with-preview
• /werft with-integration-tests=workspace
  Valid options are all, workspace, webapp, ide

[werft-gitpod-dev-com]

started the job as gitpod-build-jenting-13282.12 because the annotations in the pull request description changed
(with .werft/ from main)

[werft-gitpod-dev-com]

started the job as gitpod-build-jenting-13282.16 because the annotations in the pull request description changed
(with .werft/ from main)

[jenting]

/werft run

👍 started the job as gitpod-build-jenting-13282.18
(with .werft/ from main)

[jenting]

/werft run

👍 started the job as gitpod-build-jenting-13282.19
(with .werft/ from main)

[jenting]

/werft run recreate-vm=true

👍 started the job as gitpod-build-jenting-13282.27
(with .werft/ from main)

[utam0k]

/werft run with-integration-tests=workspace

👍 started the job as gitpod-build-jenting-13282.28
(with .werft/ from main)