Add support for pausing cluster reconcilation

[Karthik-K-N]

What this PR does / why we need it:

This PR adds support for pausing a cluster reconcilation, to facilitate that it adds event filters and predicates while setting up the controller.

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #1730

Special notes for your reviewer:

/area provider/ibmcloud

1. Please confirm that if this PR changes any image versions, then that's the sole change this PR makes.

Release note:

Add support for pausing IBMPowerVSCluster and IBMPowerVSMachine reconcilation

[Karthik-K-N]

/hold
Need some more testing

[netlify]

✅ Deploy Preview for kubernetes-sigs-cluster-api-ibmcloud ready!

Name	Link
🔨 Latest commit	cec2ee6
🔍 Latest deploy log	https://app.netlify.com/sites/kubernetes-sigs-cluster-api-ibmcloud/deploys/672870ae706b9c0008ad291d
😎 Deploy Preview	https://deploy-preview-1769--kubernetes-sigs-cluster-api-ibmcloud.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.

[Karthik-K-N]

Not able to completely test the end to end flow with create-infra workflow (I could see the machines are going into emergency mode, this is not related to this PR.
),but I could see the reconcilations being paused after adding cluster.x-k8s.io/paused: "true".
I will be trying with old workflow.

[Karthik-K-N]

Tested on cluster with infra create workflow and works as expected. on setting cluster.x-k8s.io/paused: "true" on IBMPowerVSCluster resource I could see , reconcilation pausing.

I0516 08:32:51.374797       1 generic_predicates.go:191] "Resource is paused, will not attempt to map resource" predicate="ResourceNotPaused" eventType="update" namespace="default" ="capi-karthik-160511"
I0516 08:32:51.374850       1 generic_predicates.go:191] "Resource is paused, will not attempt to map resource" predicate="ResourceNotPaused" eventType="update" namespace="default" ="capi-karthik-160511"

[Karthik-K-N]

Ready for review
/hold cancel

[Karthik-K-N]

Even this PR is ready for review

Trying to delete a paused machine

"Resource is paused, will not attempt to map resource" predicate="ResourceNotPaused" eventType="update" namespace="default" ="karthikkn-capi-powervs-control-plane-pqkp5"

[mkumatag]

/cc @dharaneeshvrd

[dharaneeshvrd]

Changes lgtm.
One suggestion is that, if you can document how to use this feature that would be great IMO.

[Karthik-K-N]

Re-based and updated the PR

[Karthik-K-N]

Changes lgtm. One suggestion is that, if you can document how to use this feature that would be great IMO.

Thanks, This change is more towards developer oriented, Use case is to pause the reconciliation when external controller is handling it.
More info about the cluster-api provided tools for pausing is available in api doc, For reference

1. https://github.com/kubernetes-sigs/cluster-api/blob/main/api/v1beta1/cluster_types.go#L47-L49
2. https://github.com/kubernetes-sigs/cluster-api/blob/main/api/v1beta1/common_types.go#L98-L103
3. clusterctl command: https://cluster-api.sigs.k8s.io/clusterctl/commands/alpha-rollout#pauseresume

Thought no need of having it under capibm book as there is no mention about it in capi book as well. Please let me know your opinion.

[dharaneeshvrd]

Ok fine in that case.

[Prajyot-Parab]

/lgtm

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dharaneeshvrd, Karthik-K-N, Prajyot-Parab

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [Prajyot-Parab]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment