Skip to content

Use Mamba in Azure CI #45902

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Feb 26, 2022
Merged

Use Mamba in Azure CI #45902

merged 7 commits into from
Feb 26, 2022

Conversation

jonashaag
Copy link
Contributor

@jonashaag jonashaag commented Feb 9, 2022

Use Mamba in Azure CI to save ~10 minutes of setup time.

  • closes #xxxx (Replace xxxx with the Github issue number)
  • Tests added and passed if fixing a bug or adding a new feature
  • All code checks passed.
  • Added an entry in the latest doc/source/whatsnew/vX.X.X.rst file if fixing a bug or adding a new feature.

@jonashaag jonashaag force-pushed the azure-mamba branch 2 times, most recently from 5c6d2e0 to cc790fe Compare February 11, 2022 15:15
@jbrockmendel jbrockmendel added the CI Continuous Integration label Feb 11, 2022
@jonashaag jonashaag marked this pull request as ready for review February 12, 2022 09:02
@jonashaag jonashaag changed the title Try Mamba in Azure CI Use Mamba in Azure CI Feb 15, 2022
@jonashaag
Copy link
Contributor Author

ping @mroeschke

@mroeschke
Copy link
Member

Did mamba solve unpinned dependencies differently than conda for builds in Azure?

For example in GHA builds, I noticed mamba would install pyarrow=2 while conda would install pyarrow=6

@jonashaag
Copy link
Contributor Author

jonashaag commented Feb 21, 2022

It seems like it always installs Arrow 6, so no change in version.

Edit: Ran a diff of all versions, no changes except for build numbers which are due to different start times I am assuming.

@mroeschke mroeschke added this to the 1.4.2 milestone Feb 21, 2022
@simonjayhawkins
Copy link
Member

@jonashaag please don't force push after an approval.

@jonashaag
Copy link
Contributor Author

@simonjayhawkins Thanks, will keep that in mind in the future. In this case it was a rebase to latest main using the GitHub UI.

@jonashaag
Copy link
Contributor Author

Hmm, seems like there is a problem with Azure and Mamba, see mamba-org/mamba#488

    RuntimeError: Operation not permitted: '/usr/local/miniconda/pkgs/cache/dd44a73b.json'

@mroeschke
Copy link
Member

Hmm, seems like there is a problem with Azure and Mamba, see mamba-org/mamba#488

    RuntimeError: Operation not permitted: '/usr/local/miniconda/pkgs/cache/dd44a73b.json'

Is this a full blocker for implementing this?

@jonashaag
Copy link
Contributor Author

Let's try the workaround suggested there.

@jonashaag
Copy link
Contributor Author

This seems to fix the issue, although I'm not sure if will reappear. The other repos that have this implemented successfully for some time indicate that it's not the case but I don't feel confident about that.

@jreback jreback merged commit 40e63c4 into pandas-dev:main Feb 26, 2022
@jreback
Copy link
Contributor

jreback commented Feb 26, 2022

thanks @jonashaag very nice!

@jreback
Copy link
Contributor

jreback commented Feb 26, 2022

@meeseeksdev backport 1.4.x

@lumberbot-app
Copy link

lumberbot-app bot commented Feb 26, 2022

Something went wrong ... Please have a look at my logs.

jreback pushed a commit that referenced this pull request Feb 26, 2022
yehoshuadimarsky pushed a commit to yehoshuadimarsky/pandas that referenced this pull request Jul 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Continuous Integration
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants