Skip to content

Apply failing projects for more resources #4573

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
humitos opened this issue Aug 27, 2018 · 1 comment
Closed

Apply failing projects for more resources #4573

humitos opened this issue Aug 27, 2018 · 1 comment
Labels
Accepted Accepted issue on our roadmap Improvement Minor improvement to code

Comments

@humitos
Copy link
Member

humitos commented Aug 27, 2018

We have been experimenting with issues regarding CPU time and RAM memory when constructing documentation. Because of this reason, we have been increasing CPU time on projects that need more to build properly and we have thoughts several ideas on how to manage this resources in a smart way at #4403

The process of increasing the resources can't be automatic since any misconfigured (or vandalism) project will be given a lot of resources and will make our servers to crash.

Now that we have a specific celery queue for this kind of projects (#4553) we want to define a process for users to apply to that queue and be able to build their documentation without RAM issues.

NOTE: the downside for the projects that pick this queue is that they will need to wait a little more for the worker to pick their build. In the end, the build will take a little more time.

Things we want to consider:

  • autodetect that a project has been failing for many days
  • check the project is not SPAM, vandalism or similar
  • notify the project's owner informing the ability to apply for more resources
  • suggest the project's owner our guide for these cases: https://docs.readthedocs.io/en/latest/guides/build-using-too-many-resources.html
  • if none of those proposed "solutions" apply to the project, we should route their builds to this custom queue

We may want to include a section in that documentation page talking about this process, like: "If you already tried all of the steps from this guide and you are still experiencing issues, please open an issue on GitHub explaining this and asking for more resources"

Ref: https://github.com/rtfd/readthedocs-ops/pull/395#issuecomment-415458429

@ericholscher
Copy link
Member

This is now being done automatically I believe 👍 https://blog.readthedocs.com/better-conda-support/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Accepted Accepted issue on our roadmap Improvement Minor improvement to code
Projects
None yet
Development

No branches or pull requests

2 participants