CI: Setup 3.9 Travis Build #33505

alimcmaster1 · 2020-04-12T22:57:21Z

closes BUG: Test failures with CPython master #33395
In a very similar fashion to @jbrockmendel work for 3.8 - might be useful to have start a 3.9 build so we can start eliminating the issues @TomAugspurger mentioned in BUG: Test failures with CPython master #33395.

This is using currently using Python 3.9.0a5+

Currently failing with

ImportError while loading conftest '/home/travis/build/pandas-dev/pandas/pandas/conftest.py'.
pandas/conftest.py:1123: in <module>
    ("period", [pd.Period(2013), pd.NaT, pd.Period(2018)]),
pandas/_libs/tslibs/period.pyx:2470: in pandas._libs.tslibs.period.Period.__new__
    freq = Resolution.get_freq(reso)
pandas/_libs/tslibs/resolution.pyx:240: in pandas._libs.tslibs.resolution.Resolution.get_freq
    return cls._reso_freq_map[resostr]
E   AttributeError: type object 'type' has no attribute '_reso_freq_map'
The command "ci/run_tests.sh" exited with 4.
cache.2
store build cache

alimcmaster1 · 2020-04-14T23:54:30Z

Test failures currently related to: #33507

jbrockmendel · 2020-04-23T16:39:04Z

@alimcmaster1 did we determine this needs to wait on an upstream fix?

jreback

let us know when ready

jreback · 2020-04-23T17:11:24Z

ci/build39.sh

+python -c "import hypothesis"
+
+# TODO: Is there anything else in setup_env that we really want to do?
+# ci/setup_env.sh


add a line at the end

minor comments

alimcmaster1 · 2020-04-23T23:09:21Z

@alimcmaster1 did we determine this needs to wait on an upstream fix?

Yes waiting on a fix to the current cython alpha - cython/cython#3544.

(We cant use current cython release due to a different issue - cython/cython#3395)

Will ping on here when ready.

@jbrockmendel

TomAugspurger · 2020-04-28T13:52:39Z

@alimcmaster1 you may need to manually skip the clipboard tests on this build.

Skip clipboard tests

alimcmaster1 · 2020-05-02T00:25:11Z

/azp run

azure-pipelines · 2020-05-02T00:25:16Z

Commenter does not have sufficient privileges for PR 33505 in repo pandas-dev/pandas

alimcmaster1 · 2020-05-02T00:59:37Z

Azure pipelines don't seem to be triggering

alimcmaster1 · 2020-05-02T12:52:19Z

@pandas-dev/pandas-core 3.9 build is ready. (Azure seems to be playing up - all jobs have ran but doesn’t seem to be reporting back to my PR)

jreback

can u add an issue to revert this once conda builds are good

a question about wheels

jreback · 2020-05-02T13:04:28Z

ci/build39.sh

+pip install cython --pre # https://github.com/cython/cython/issues/3395
+
+# Alternative for getting numpy:
+# pip install --pre -f https://7933911d6844c6c53a7d-47bd50c35cd79bd838daf386af554a83.ssl.cf2.rackcdn.com/ numpy


do these wheels work yet?

jreback · 2020-05-02T23:21:08Z

ci/build39.sh

-python setup.py install
-cd ..
-rm -rf numpy
+pip install --pre -f https://7933911d6844c6c53a7d-47bd50c35cd79bd838daf386af554a83.ssl.cf2.rackcdn.com numpy


this might not be the right address iirc this changed
maybe have to look on the numpy issue list

Its the same address we use in the numpy dev build? - https://github.com/pandas-dev/pandas/blob/master/ci/deps/azure-37-numpydev.yaml#L19

these might be older:

https://anaconda.org/scipy-wheels-nightly/numpy/files
i think is the new location (includes scipy as well)

let’s update

Ahh nice - thanks wasn't aware! Will update the numpy dev build too in a separate PR.

thanks!

alimcmaster1 · 2020-05-02T23:56:15Z

all green & raised an issue for later follow ups @jreback

alimcmaster1 · 2020-05-04T23:08:32Z

Resorted to building numpy from source:

https://anaconda.org/scipy-wheels-nightly/numpy/files has no 3.9 whl available yet.
previous attempting running pip install --pre -f https://7933911d6844c6c53a7d-47bd50c35cd79bd838daf386af554a83.ssl.cf2.rackcdn.com numpy`
was just grabbing latest numpy release (logs below) - whereas we probably want to use master/nightly build here.

Collecting numpy
  Downloading numpy-1.18.3.zip (5.4 MB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Building wheels for collected packages: numpy
  Building wheel for numpy (PEP 517): started
  Building wheel for numpy (PEP 517): still running...
  Building wheel for numpy (PEP 517): still running...
  Building wheel for numpy (PEP 517): finished with status 'done'
  Created wheel for numpy: filename=numpy-1.18.3-cp39-cp39-linux_x86_64.whl size=15218460 sha256=a8ece5537cef5c3f6110576f4937c80bfc60d6a3d4a6c6d27353b2e3dc6f677e
  Stored in directory: /home/travis/.cache/pip/wheels/b0/63/be/cd7680896e3713ce13b5b5748563e78e0cfe5ea9c0c20143a1```

alimcmaster1 · 2020-05-09T22:40:37Z

@jreback @jbrockmendel any comments here? All green

jreback · 2020-05-09T22:48:45Z

ci/build39.sh

+pip install cython --pre # https://github.com/cython/cython/issues/3395
+
+git clone https://github.com/numpy/numpy
+cd numpy


can we use the wheel instead?
iirc the existing dev build was already changed

I tried above - but there are no 3.9 wheels available yet on scipy-wheels-night or the old rackcdn url

Will update when available - tracking in #33948

jreback · 2020-05-09T23:27:05Z

thanks @alimcmaster1

* Python 3.9 build * Python 3.9 build * Python 3.9 build * Python 3.9 build * Update build39.sh minor comments * Update .travis.yml Skip clipboard tests * Python 3.9 tests * Dummy commit * Use numpy master manylinux wheel * use scipy nightly wheels * Build numpy from source

alimcmaster1 added 3 commits April 12, 2020 21:28

Python 3.9 build

93119ec

Python 3.9 build

e3974d6

Python 3.9 build

5bc23f9

alimcmaster1 added Python 3.9 CI Continuous Integration labels Apr 12, 2020

Python 3.9 build

b580039

jreback requested changes Apr 23, 2020

View reviewed changes

Update build39.sh

26e2642

minor comments

alimcmaster1 closed this Apr 27, 2020

alimcmaster1 reopened this Apr 27, 2020

alimcmaster1 added 3 commits April 30, 2020 01:27

Update .travis.yml

75ef91a

Skip clipboard tests

Merge remote-tracking branch 'upstream/master' into setup39

6281ceb

Merge remote-tracking branch 'origin/setup39' into setup39

629b147

alimcmaster1 changed the title ~~WIP: CI: Setup 3.9 Travis Build~~ CI: Setup 3.9 Travis Build May 1, 2020

Python 3.9 tests

7ff552f

alimcmaster1 closed this May 2, 2020

alimcmaster1 reopened this May 2, 2020

alimcmaster1 closed this May 2, 2020

alimcmaster1 reopened this May 2, 2020

alimcmaster1 closed this May 2, 2020

alimcmaster1 reopened this May 2, 2020

alimcmaster1 closed this May 2, 2020

alimcmaster1 reopened this May 2, 2020

Dummy commit

6dc7322

jreback requested changes May 2, 2020

View reviewed changes

Use numpy master manylinux wheel

aaa835f

alimcmaster1 mentioned this pull request May 2, 2020

CI: Move Python 3.9 Build to Conda #33948

Closed

jreback reviewed May 2, 2020

View reviewed changes

use scipy nightly wheels

b7b74c5

jreback mentioned this pull request May 4, 2020

CI: Bump numpydev URL #33968

Merged

Build numpy from source

21cce3f

Merge remote-tracking branch 'upstream/master' into setup39

e3ad3fd

alimcmaster1 closed this May 5, 2020

alimcmaster1 reopened this May 5, 2020

alimcmaster1 closed this May 5, 2020

alimcmaster1 reopened this May 5, 2020

alimcmaster1 added 2 commits May 5, 2020 18:11

Merge remote-tracking branch 'upstream/master' into setup39

ab03303

Merge remote-tracking branch 'upstream/master' into setup39

9bb67ae

jreback added this to the 1.1 milestone May 9, 2020

jreback requested changes May 9, 2020

View reviewed changes

jreback approved these changes May 9, 2020

View reviewed changes

jreback merged commit 89e44e6 into pandas-dev:master May 9, 2020

alimcmaster1 mentioned this pull request May 10, 2020

BUG: Test failures with CPython master #33395

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

CI: Setup 3.9 Travis Build #33505

CI: Setup 3.9 Travis Build #33505

alimcmaster1 commented Apr 12, 2020 •

edited

Loading

alimcmaster1 commented Apr 14, 2020

jbrockmendel commented Apr 23, 2020

jreback left a comment

jreback Apr 23, 2020

alimcmaster1 commented Apr 23, 2020 •

edited

Loading

TomAugspurger commented Apr 28, 2020

alimcmaster1 commented May 2, 2020

azure-pipelines bot commented May 2, 2020

alimcmaster1 commented May 2, 2020

alimcmaster1 commented May 2, 2020

jreback left a comment

jreback May 2, 2020

jreback May 2, 2020

alimcmaster1 May 2, 2020

jreback May 3, 2020

alimcmaster1 May 3, 2020

alimcmaster1 commented May 2, 2020

alimcmaster1 commented May 4, 2020 •

edited

Loading

alimcmaster1 commented May 9, 2020

jreback May 9, 2020

alimcmaster1 May 9, 2020

jreback May 9, 2020

alimcmaster1 May 10, 2020

jreback commented May 9, 2020

CI: Setup 3.9 Travis Build #33505

CI: Setup 3.9 Travis Build #33505

Conversation

alimcmaster1 commented Apr 12, 2020 • edited Loading

alimcmaster1 commented Apr 14, 2020

jbrockmendel commented Apr 23, 2020

jreback left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

alimcmaster1 commented Apr 23, 2020 • edited Loading

TomAugspurger commented Apr 28, 2020

alimcmaster1 commented May 2, 2020

azure-pipelines bot commented May 2, 2020

alimcmaster1 commented May 2, 2020

alimcmaster1 commented May 2, 2020

jreback left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

alimcmaster1 commented May 2, 2020

alimcmaster1 commented May 4, 2020 • edited Loading

alimcmaster1 commented May 9, 2020

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

jreback commented May 9, 2020

alimcmaster1 commented Apr 12, 2020 •

edited

Loading

alimcmaster1 commented Apr 23, 2020 •

edited

Loading

alimcmaster1 commented May 4, 2020 •

edited

Loading