Skip to content

CI: Try running single_cpu/not single_cpu tests together #52239

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Mar 30, 2023

Conversation

lithomas1
Copy link
Member

@lithomas1 lithomas1 commented Mar 27, 2023

  • closes #xxxx (Replace xxxx with the GitHub issue number)
  • Tests added and passed if fixing a bug or adding a new feature
  • All code checks passed.
  • Added type annotations to new arguments/methods/functions.
  • Added an entry in the latest doc/source/whatsnew/vX.X.X.rst file if fixing a bug or adding a new feature.

If I did this right, should get us from 20 jobs to around 14 jobs.

This'll probably slow down the current jobs by ~10 minutes (but they already take 1 hr), but we'll save at least the 5 minutes of compiling pandas on the single_cpu jobs + whatever it takes to setup the conda envs there.

Hopefully the shorter queue times during peak periods makes up for the extra time.

@lithomas1 lithomas1 added the CI Continuous Integration label Mar 27, 2023
@lithomas1
Copy link
Member Author

This doesn't quite work yet (need to figure out how to propagate the PATTERN variable).

@mroeschke
Copy link
Member

I would recommend bumping up the timeout-minutes since 1 job has to run more sets of tests now

@lithomas1 lithomas1 marked this pull request as ready for review March 27, 2023 23:45
@lithomas1
Copy link
Member Author

I would recommend bumping up the timeout-minutes since 1 job has to run more sets of tests now

It's already 3 hours which should be fine (all tests seem to take about 1ish hour).

@lithomas1 lithomas1 added this to the 2.0 milestone Mar 28, 2023
@lithomas1 lithomas1 requested a review from mroeschke March 28, 2023 02:01
@mroeschke
Copy link
Member

Looks like on the latest commit that the single cpu task isn't running

@mroeschke
Copy link
Member

Nice cleanup! Thanks @lithomas1. Hoping to follow up with #52211 to reduce the number of queued workflows even further

@lithomas1 lithomas1 deleted the merge-single-cpu-jobs branch March 30, 2023 01:14
mroeschke pushed a commit that referenced this pull request Mar 30, 2023
…ngle_cpu tests together) (#52292)

Backport PR #52239: CI: Try running single_cpu/not single_cpu tests together

Co-authored-by: Thomas Li <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Continuous Integration
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants