-
-
Notifications
You must be signed in to change notification settings - Fork 18.4k
CI: Add ASV Bot #42911
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CI: Add ASV Bot #42911
Conversation
* CI: ASV Bot * Rename main.yml to asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Remove debug stuff
can u require a regex to target only matching benchmarks? would make it way faster |
most PRs would be OK with |
@lithomas1 happy to merge this and can PR again to update, lmk. (ideally would like the selective benchmarks though) |
Looking to get some more changes in. This may take a while though. |
* remove debug statement * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml * Update asv-bot.yml
Got the regexes working. e.g. lithomas1#7 (comment) Unfortunately doesn't work with -b (?!libs) right now. I guess it doesn't like the backslash. I think I'll try to get this to work in a follow up. This PR is already getting large. |
thanks @lithomas1 |
Triggers with command
@github-actions benchmark -b ^regexgoeshere
(doesn't work rn, needs to be merged to work, this is an example result though, lithomas1#6 (comment), which is me testing it on the io.csv benchmarks). Our benchmarks are super slow right now, they take six hours to do, so having this bot might help for people with weaker computers. Unfortunately, this also can clog up our CI pipelines, so I added a concurrency limit, which restricts runs to 1 per person.cc @jbrockmendel @simonjayhawkins