Skip to content

CI/WEB: Adding cache for maintainers' github info #50485

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Dec 29, 2022

Conversation

datapythonista
Copy link
Member

I've seen some CI failures recently caused by hitting github API quota when building the website. The website requests from github the info of maintainers to show names and photos in https://pandas.pydata.org/about/team.html (also the releases in the home, but that's a single request not affecting the quota much).

Feels like in the past every github worker was independent and had its own quota, but now seems like running jobs too quickly hits the quota. In this PR I add a cache to reuse the maintainers info for one hour (the time it takes the quota to reset), which should avoid those failures.

@datapythonista datapythonista added CI Continuous Integration Web pandas website labels Dec 29, 2022
Copy link
Member

@MarcoGorelli MarcoGorelli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me! Feel free to merge, can always revert if it doesn't fix the issue

@datapythonista datapythonista merged commit 2899f46 into pandas-dev:main Dec 29, 2022
@datapythonista
Copy link
Member Author

Thanks for the review. The changes to the script work well, tried locally.

@phofl
Copy link
Member

phofl commented Jan 4, 2023

I guess we should backport? Seeing the same failures on 1.5.x

@datapythonista
Copy link
Member Author

@meeseeksdev please backport to 1.5.x

@datapythonista
Copy link
Member Author

Yep, good point, I didn't think about it.

@phofl phofl added this to the 1.5.3 milestone Jan 4, 2023
phofl pushed a commit that referenced this pull request Jan 4, 2023
…ers' github info) (#50551)

Backport PR #50485: CI/WEB: Adding cache for maintainers' github info

Co-authored-by: Marc Garcia <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Continuous Integration Web pandas website
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants