Skip to content

Maintenance: optimize End to End tests mechanism to create powertools Layer once #1345

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
1 of 2 tasks
mploski opened this issue Jul 22, 2022 · 3 comments
Closed
1 of 2 tasks
Labels
tech-debt Technical Debt tasks

Comments

@mploski
Copy link
Contributor

mploski commented Jul 22, 2022

Summary

Currently we create new powertools layer for every test group in our e2e tests. It means we create 3 layers per test execution. If we multiply it by number of Python runtime we run tests in parallel (python 3.7,3.8, 3.9) we have 9 layers built for every github action executed.
It consumes resources (CPU, IOPS, Network Bandwidth) and can slow down overall test execution on constraint environments like github action workers.

Why is this needed?

It optimize resource utilization on build machine and thus lower down time needed to conduct tests and enable better scalability/cost control

Which area does this relate to?

No response

Solution

No response

Acknowledgment

@mploski mploski added triage Pending triage from maintainers internal Maintenance changes labels Jul 22, 2022
@mploski mploski changed the title Maintenance: Optimize End to End tests mechanism to create powertools Layer once Maintenance: optimize End to End tests mechanism to create powertools Layer once Jul 22, 2022
@heitorlessa heitorlessa removed the triage Pending triage from maintainers label Aug 8, 2022
@heitorlessa heitorlessa added the pending-release Fix or implementation already in dev waiting to be released label Aug 22, 2022
@heitorlessa
Copy link
Contributor

Implemented by #1466

@github-actions
Copy link
Contributor

⚠️COMMENT VISIBILITY WARNING⚠️

This issue is now closed. Please be mindful that future comments are hard for our team to see.

If you need more assistance, please either tag a team member or open a new issue that references this one.

If you wish to keep having a conversation with other community members under this issue feel free to do so.

@github-actions
Copy link
Contributor

This is now released under 1.28.0 version!

@github-actions github-actions bot removed the pending-release Fix or implementation already in dev waiting to be released label Aug 25, 2022
@heitorlessa heitorlessa added tech-debt Technical Debt tasks and removed internal Maintenance changes labels Apr 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tech-debt Technical Debt tasks
Projects
None yet
Development

No branches or pull requests

2 participants