Skip to content

CI: Add ASV Bot #42911

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Sep 4, 2021
Merged

CI: Add ASV Bot #42911

merged 5 commits into from
Sep 4, 2021

Conversation

lithomas1
Copy link
Member

@lithomas1 lithomas1 commented Aug 6, 2021

  • closes CI: ASV Bot #41157
  • tests added / passed
  • Ensure all linting tests pass, see here for how to run them
  • whatsnew entry

Triggers with command @github-actions benchmark -b ^regexgoeshere(doesn't work rn, needs to be merged to work, this is an example result though, lithomas1#6 (comment), which is me testing it on the io.csv benchmarks). Our benchmarks are super slow right now, they take six hours to do, so having this bot might help for people with weaker computers. Unfortunately, this also can clog up our CI pipelines, so I added a concurrency limit, which restricts runs to 1 per person.

cc @jbrockmendel @simonjayhawkins

* CI: ASV Bot

* Rename main.yml to asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Remove debug stuff
@jreback
Copy link
Contributor

jreback commented Aug 6, 2021

can u require a regex to target only matching benchmarks? would make it way faster

@jbrockmendel
Copy link
Member

most PRs would be OK with -b \(\?\!libs\)

@jreback jreback added the Benchmark Performance (ASV) benchmarks label Aug 8, 2021
@jreback jreback added this to the 1.4 milestone Aug 8, 2021
@jreback
Copy link
Contributor

jreback commented Aug 8, 2021

@lithomas1 happy to merge this and can PR again to update, lmk. (ideally would like the selective benchmarks though)

@lithomas1
Copy link
Member Author

Looking to get some more changes in. This may take a while though.

* remove debug statement

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml

* Update asv-bot.yml
@lithomas1
Copy link
Member Author

Got the regexes working. e.g. lithomas1#7 (comment)

Unfortunately doesn't work with -b (?!libs) right now. I guess it doesn't like the backslash.

I think I'll try to get this to work in a follow up. This PR is already getting large.

@lithomas1 lithomas1 requested a review from jreback September 4, 2021 00:31
@jreback jreback merged commit ba72f5e into pandas-dev:master Sep 4, 2021
@jreback
Copy link
Contributor

jreback commented Sep 4, 2021

thanks @lithomas1

feefladder pushed a commit to feefladder/pandas that referenced this pull request Sep 7, 2021
@lithomas1 lithomas1 deleted the asv-bot-submit branch September 18, 2021 17:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Benchmark Performance (ASV) benchmarks
Projects
None yet
Development

Successfully merging this pull request may close these issues.

CI: ASV Bot
3 participants