Proxito: inactive versions produce infinite redirect when the HTML exists in the storage

[humitos]

It seems that when a version is active=False but its HTML files exist in the storage, we get an infinite redirect:

$ curl -IL http://docs.reprozip.org/en/0.6.1/
...
curl: (47) Maximum (50) redirects followed

El Proxito should return 404 in these situations.

Reference: https://twitter.com/remram44/status/1536882673821655040
Reference: https://github.com/readthedocs/readthedocs-ops/issues/1139
Reference: #9109

[stsewd]

This also looks like we failed to remove the files from storage when the version was inactivated.

[humitos]

Yeah, we have a lot of these. They are different problems, tho, and I think we should fix both. However, I'm sure there will be always situations where we fail to delete an inactive version from the storage.

[stsewd]

Looks like we are deleting files when the version is deactivated from the form, but not from the API.

readthedocs.org/readthedocs/projects/views/private.py

Lines 213 to 224 in a2ca1af

	if form.has_changed():
	if 'active' in form.changed_data and version.active is False:
	log.info(
	'Removing files for version.',
	version_slug=version.slug,
	)
	clean_project_resources(
	version.project,
	version,
	)
	version.built = False
	version.save()

Also, we should probably always call the delete function if the version isn't active without checking if the form has changed (just in case the deletion failed, users can just press save).

Also, wonder if we could move this to the save method, but maybe we didn't put it there since it's called too many times (even for an inactive version)?

[domdfcoding]

Presumably related to this issue, I'm seeing an endless redirect for epub download urls:

$ curl -L https://domdf-python-tools.readthedocs.io/_/downloads/en/stable/epub/
curl: (47) Maximum (50) redirects followed

For this project I only have HTML and PDF builds enabled. PDF URL works fine. This project used to have epub builds enabled, but the problem still presents itself for projects where they were disabled from the beginning.

[humitos]

Related to #9468

[stsewd]

With #10153, this shouldn't happen anymore. Previously we were raising a 404 (inactive version), then our 404 handler would see that there is an index file and redirect again to the same path (index file redirect).

Now we check that the URL already ends with / and skip the check for the index file.

But we are missing deleting the files from a version when it's deactivated from the API #9335 (comment).

[stsewd]

Closing this in favor of #10221, since the original problem is solved.