Skip to content

BLD: don't require ninja to come from PyPI #54244

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jul 25, 2023

Conversation

eli-schwartz
Copy link
Contributor

In pyproject.toml, the baseline requirements for building are supposed to be listed.

Many end users have a recent enough system-provided ninja, and don't need to install a new copy into every pandas isolated build virtual environment. This is handled inside meson-python itself, which dynamically adds an additional build requirement on ninja via the backend hook get_requires_for_build_sdist, but only if a suitable system version is not found.

This is especially helpful on systems where an OS ninja is installed, but the platform is obscure enough that there are no PyPI "ninja" wheels, thus forcing pip install pandas to download an additional copy of the ninja source code and build it via cmake before beginning to install pandas itself. This is not guaranteed to work...

The ninja entry in various CI or developer-recommended workflows is left alone because they are opt-in. In such contexts, it may make sense to be fairly specific about which providers you want to use for any given dependency, and that's a workflow preference encoded as a workflow build command. Since it doesn't prevent people from using the baseline install command, this commit makes no value judgment regarding it.

In pyproject.toml, the baseline requirements for building are supposed
to be listed.

Many end users have a recent enough system-provided ninja, and don't
need to install a new copy into every pandas isolated build virtual
environment. This is handled inside meson-python itself, which
dynamically adds an additional build requirement on ninja via the
backend hook `get_requires_for_build_sdist`, but only if a suitable
system version is not found.

This is especially helpful on systems where an OS ninja is installed,
but the platform is obscure enough that there are no PyPI "ninja"
wheels, thus forcing `pip install pandas` to download an additional
copy of the ninja source code and build it via cmake before beginning to
install pandas itself. This is not guaranteed to work...

The ninja entry in various CI or developer-recommended workflows is left
alone because they are opt-in. In such contexts, it may make sense to be
fairly specific about which providers you want to use for any given
dependency, and that's a workflow preference encoded as a workflow build
command. Since it doesn't prevent people from using the baseline
install command, this commit makes no value judgment regarding it.
@eli-schwartz eli-schwartz changed the title don't require ninja to come from PyPI BLD: don't require ninja to come from PyPI Jul 24, 2023
@mroeschke mroeschke added the Build Library building on various platforms label Jul 24, 2023
@mroeschke mroeschke mentioned this pull request Jul 24, 2023
5 tasks
@mroeschke mroeschke requested a review from lithomas1 July 25, 2023 17:57
@lithomas1 lithomas1 added this to the 2.1 milestone Jul 25, 2023
@lithomas1 lithomas1 merged commit f49cd3b into pandas-dev:main Jul 25, 2023
@lithomas1
Copy link
Member

thanks @eli-schwartz.

@eli-schwartz eli-schwartz deleted the pyproject-ninja branch July 25, 2023 18:38
jamie-harness pushed a commit to jamie-harness/pandas1 that referenced this pull request Jul 26, 2023
In pyproject.toml, the baseline requirements for building are supposed
to be listed.

Many end users have a recent enough system-provided ninja, and don't
need to install a new copy into every pandas isolated build virtual
environment. This is handled inside meson-python itself, which
dynamically adds an additional build requirement on ninja via the
backend hook `get_requires_for_build_sdist`, but only if a suitable
system version is not found.

This is especially helpful on systems where an OS ninja is installed,
but the platform is obscure enough that there are no PyPI "ninja"
wheels, thus forcing `pip install pandas` to download an additional
copy of the ninja source code and build it via cmake before beginning to
install pandas itself. This is not guaranteed to work...

The ninja entry in various CI or developer-recommended workflows is left
alone because they are opt-in. In such contexts, it may make sense to be
fairly specific about which providers you want to use for any given
dependency, and that's a workflow preference encoded as a workflow build
command. Since it doesn't prevent people from using the baseline
install command, this commit makes no value judgment regarding it.
jamie-harness added a commit to jamie-harness/pandas1 that referenced this pull request Jul 26, 2023
In pyproject.toml, the baseline requirements for building are supposed
to be listed.

Many end users have a recent enough system-provided ninja, and don't
need to install a new copy into every pandas isolated build virtual
environment. This is handled inside meson-python itself, which
dynamically adds an additional build requirement on ninja via the
backend hook `get_requires_for_build_sdist`, but only if a suitable
system version is not found.

This is especially helpful on systems where an OS ninja is installed,
but the platform is obscure enough that there are no PyPI "ninja"
wheels, thus forcing `pip install pandas` to download an additional
copy of the ninja source code and build it via cmake before beginning to
install pandas itself. This is not guaranteed to work...

The ninja entry in various CI or developer-recommended workflows is left
alone because they are opt-in. In such contexts, it may make sense to be
fairly specific about which providers you want to use for any given
dependency, and that's a workflow preference encoded as a workflow build
command. Since it doesn't prevent people from using the baseline
install command, this commit makes no value judgment regarding it.

Co-authored-by: Eli Schwartz <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Build Library building on various platforms
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants