Skip to content

CI: arm Travis build timing out #36719

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
jbrockmendel opened this issue Sep 29, 2020 · 10 comments · Fixed by #40868
Closed

CI: arm Travis build timing out #36719

jbrockmendel opened this issue Sep 29, 2020 · 10 comments · Fixed by #40868
Assignees
Labels
ARM aarch64 architecture CI Continuous Integration
Milestone

Comments

@jbrockmendel
Copy link
Member

I'm seeing this in most but not all builds ATM.

Even if we moved it to allowed-failures, it would still be slowing the Travis turnaround time down a lot.

@jbrockmendel jbrockmendel added Bug Needs Triage Issue that has not been reviewed by a pandas team member CI Continuous Integration and removed Bug Needs Triage Issue that has not been reviewed by a pandas team member labels Sep 29, 2020
@jreback
Copy link
Contributor

jreback commented Sep 29, 2020

can we ping original implementer of arm support (i don't remember the github id)

also might be helpful to run this build more verbosely to see if can nail down where it's hanging

@TomAugspurger
Copy link
Contributor

TomAugspurger commented Sep 29, 2020

cc @janaknat from MacPython/pandas-wheels#99 and @odidev from the original issue.

Here's an example timeout: https://travis-ci.org/github/pandas-dev/pandas/jobs/731231340

@janaknat
Copy link

@TomAugspurger @jreback It would help if pandas-dev migrated to travis-ci.com from travis-ci.org.

I did a test run on travis-ci.com using Graviton2: https://travis-ci.com/github/janaknat/pandas/jobs/392535745

travis-ci.com offers Graviton2 instances for building/testing in an ARM64 environment. That will speed things up significantly.
See: https://blog.travis-ci.com/2020-09-11-arm-on-aws

@odidev
Copy link

odidev commented Sep 29, 2020

I have tested this again and there is inconsistency in build timings in arm64 for each build. So, I have tested with arm64-graviton2 in travis-ci.com, and build ran in 25 mins(almost similar to AMD64).

ARM64-Graviton2 build report: https://travis-ci.com/github/odidev/pandas/jobs/392555700

@jbrockmendel
Copy link
Member Author

Disable until this is sorted out?

@jreback
Copy link
Contributor

jreback commented Sep 30, 2020

@TomAugspurger @jreback It would help if pandas-dev migrated to travis-ci.com from travis-ci.org.

I did a test run on travis-ci.com using Graviton2: https://travis-ci.com/github/janaknat/pandas/jobs/392535745

travis-ci.com offers Graviton2 instances for building/testing in an ARM64 environment. That will speed things up significantly.
See: https://blog.travis-ci.com/2020-09-11-arm-on-aws

I don't think we have an objection to migrate (and seems we need to)

what do we need to do?

@janaknat
Copy link

@jreback documentation for migrating repos: https://docs.travis-ci.com/user/migrate/open-source-repository-migration. It shouldn't be too much of a hassle.

@mattip has done that for the Macpython/scipy-wheels repo.

@mustafa-travisci and @michal-at-travisci can help with more information.

@mattip
Copy link
Contributor

mattip commented Sep 30, 2020

I can do the legwork to migrate the repo (under my alias @multibuilder) if the core maintainers sign off on the idea. This would mean they would now need to sign into travis-ci.com rather than travis-ci.org or ask me in order to manage the build settings: set secrets, stop/start specific builds. Automatic triggering would work as before. We recently migrated the scipy-wheel build to travis-ci.com, so this second migration should be easier.

@jreback
Copy link
Contributor

jreback commented Jan 2, 2021

cc @fangchenli

i moved us to travis-ci.com for this one remaining build

i think if we run it with for test with a number of cores it would be reasonable

fangchenli added a commit to fangchenli/pandas that referenced this issue Jan 2, 2021
fangchenli added a commit to fangchenli/pandas that referenced this issue Jan 2, 2021
fangchenli added a commit to fangchenli/pandas that referenced this issue Jan 2, 2021
@jreback jreback added this to the 1.3 milestone Jan 3, 2021
@jreback jreback added the ARM aarch64 architecture label Jan 3, 2021
@fangchenli
Copy link
Member

github/roadmap#95 arm64 runner should be available soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ARM aarch64 architecture CI Continuous Integration
Projects
None yet
8 participants