chore(ci): adopt new CDK Toolkit Library

[dreamorosi]

Summary

Changes

Please provide a summary of what's being changed

This PR replaces the usage of the @aws-cdk/cli-lib-alpha with the newer @aws-cdk/toolkit-lib that was announced in developer preview earlier today.

This new toolkit is expected to be the way of interacting with CDK programmatically moving forward, so it makes sense for us to adopt it and remove the older @aws-cdk/cli-lib-alpha.

The switch is pretty much a drop-in replacement for us, since we were already abstracting away the CLI from the tests. The bulk of the changes are in the TestStack class in the internal testing package, which now uses the new module.

With this new toolkit we unlocked also two new benefits:

• since the new package uses the latest dist tag on npmjs.com it can now be picked up by Dependabot update, this was not the case with the @aws-cdk/cli-lib-alpha which was using a pre-release tag.
• the new module gives more control to how logs are emitted by CDK. Because of this, we can remove a lot of noise from most runs. As part of this PR I implemented a rudimentary log filtering that silences most of the logs except warnings and errors. This happens during regular runs, but when workflows are rerun with debug logging enabled everything is logged. With this change we can keep the output clean, but still have visibility when something breaks.

Finally, while not related to the new toolkit, I also changed the stack generation to include a Service tag to all resources generated as part unit test runs. This was something that I had in the backlog for a while and that will unlock some additional automation down the road. For example, now that things are tagged, we can potentially automate the removal of CloudWatch LogGroup resources, which currently are just piling up. More info on this front in the near future.

Please add the issue number below, if no issue is present the PR might get blocked and not be reviewed

Issue number: closes #3117

---

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.

[am29d]

Great work, and super fast adoption! E2E tests are green locally and in CICD. 🚀

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud