-
Notifications
You must be signed in to change notification settings - Fork 909
Add better-integ-test buildspec #1019
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Codecov Report
@@ Coverage Diff @@
## master #1019 +/- ##
============================================
+ Coverage 55.58% 55.59% +<.01%
- Complexity 4566 4567 +1
============================================
Files 810 810
Lines 27813 27813
Branches 2241 2241
============================================
+ Hits 15461 15462 +1
Misses 11638 11638
+ Partials 714 713 -1
Continue to review full report at Codecov.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Might be nice to include Kinesis to cover some of the H2 path on core or http client changes.
scripts/run-integ-test
Outdated
""" | ||
|
||
# git diff HEAD~ HEAD --name-only | ||
ret = Popen(["git", "diff", "HEAD~", "HEAD", "--name-only"], stdout=PIPE) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: can be git diff HEAD^ --name-only
return minimum_modules_to_test | ||
elif top_directory== "services": | ||
return path[1] | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There's no else
clause so this can return None
. Is that expected?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, this is expected. We don't need to run integ tests for changes in other modules such as build-tools
scripts/run-integ-test
Outdated
module = get_modules(d) | ||
if isinstance(module, list): | ||
modules.update(module) | ||
elif module: modules.add(module) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: weird formatting here
scripts/run-integ-test
Outdated
|
||
if modules: | ||
run_tests(modules) | ||
else: print("No modules configured to run. Skipping integ tests") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: weird formatting
77c73f8
to
2bb5f00
Compare
2bb5f00
to
ab8013e
Compare
…c48d712a6 Pull request: release <- staging/aecc1551-e42a-4025-aeb3-7ebc48d712a6
Description
Add
better-integ-test
buildspec to only trigger integ tests that are related to the changed files so that we can make integ tests as part of PR process.Changes in
core
,codegen
-> minimal required integ tests (s3
,dynamodb
,sqs
). I chose those three services because they can coverxml
,json
,query
protocols respectively. This is open to discussion.Changes in
netty-nio-client
->kinesis
,s3
,netty-nio-client
Changes in
url-connection-client
->url-connection-client
Changes in
apache-client
->apache-client
,s3
Changes in individual service changes -> integ test in that service module
We can add more complex logic in the future as needed.
Testing
Tested it using CodeBuild and verified the core change in this PR I made triggered the minimal required integ tests. The job took 8 mins.
License