Skip to content

CI: clean azure pipeline #38636

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 34 commits into from
Closed
Show file tree
Hide file tree
Changes from 30 commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
4912eb1
CI: use conda from ci
Dec 22, 2020
80c751e
CI: use conda from ci
Dec 22, 2020
b0ff882
CI: use conda from ci
Dec 22, 2020
7e685e8
CI: use conda from ci
Dec 22, 2020
0371e8f
CI: use conda from ci
Dec 22, 2020
2fe866a
CI: use conda from ci
Dec 22, 2020
e54d80b
CI: use conda from ci
Dec 22, 2020
079bb27
CI: use conda from ci
Dec 22, 2020
bd1af56
CI: use conda from ci
Dec 22, 2020
f323354
CI: use conda from ci
Dec 22, 2020
7c29e8b
CI: use conda from ci
Dec 23, 2020
ea745b1
CI: use conda from ci
Dec 23, 2020
bc95cde
CI: use conda from ci
Dec 23, 2020
c78dc47
CI: use conda from ci
Dec 23, 2020
c2ee4a3
CI: use conda from ci
Dec 23, 2020
fdb081b
CI: use conda from ci
Dec 23, 2020
2be2ae7
CI: use conda from ci
Dec 23, 2020
1b50515
CI: use conda from ci
Dec 23, 2020
2a4285d
Merge remote-tracking branch 'upstream/master' into refactor-azure-ci
fangchenli Jun 11, 2021
37a287a
rebase
fangchenli Jun 11, 2021
fda6a84
fix build commend
fangchenli Jun 11, 2021
a7a01d8
fix env commend
fangchenli Jun 11, 2021
f0f9b47
fix env commend
fangchenli Jun 11, 2021
144c50d
fix env commend
fangchenli Jun 11, 2021
2c8813f
update vmimage version
fangchenli Jun 11, 2021
bde28ca
fix windows
fangchenli Jun 11, 2021
14b5cb7
fix windows
fangchenli Jun 11, 2021
61932dd
fix windows
fangchenli Jun 11, 2021
a92dbf6
str
fangchenli Jun 11, 2021
025d125
Merge remote-tracking branch 'upstream/master' into refactor-azure-ci
fangchenli Jun 12, 2021
8a61398
resolve conflict
fangchenli Jul 17, 2021
6f73e01
resolve conflict
fangchenli Jul 17, 2021
49cefe9
Merge remote-tracking branch 'upstream/master' into refactor-azure-ci
fangchenli Jul 17, 2021
2d32a50
resolve conflict
fangchenli Jul 17, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 11 additions & 11 deletions azure-pipelines.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,18 +11,17 @@ variables:
PYTEST_WORKERS: auto

jobs:
# Mac and Linux use the same template
- template: ci/azure/posix.yml
- template: ci/azure/macos.yml
parameters:
name: macOS
vmImage: macOS-10.14
vmImage: macOS-10.15
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fangchenli can any of this be split off into an easy preliminary?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.


- template: ci/azure/windows.yml
parameters:
name: Windows
vmImage: vs2017-win2016
vmImage: windows-2019

- job: py37_32bit
- job: Linux_py37_32bit
pool:
vmImage: ubuntu-18.04

Expand All @@ -35,14 +34,15 @@ jobs:
. ~/virtualenvs/pandas-dev/bin/activate && \
python -m pip install --no-deps -U pip wheel setuptools && \
pip install cython numpy python-dateutil pytz pytest pytest-xdist hypothesis pytest-azurepipelines && \
python setup.py build_ext -q -j2 && \
python -m pip install --no-build-isolation -e . && \
pytest -m 'not slow and not network and not clipboard' pandas --junitxml=test-data.xml"
displayName: 'Run 32-bit manylinux2014 Docker Build / Tests'
python setup.py build_ext -q -j 4 && \
python -m pip install -e . --no-build-isolation --no-use-pep517 && \
pytest -m 'not slow and not network and not clipboard' pandas"
displayName: Run 32-bit manylinux2014 Docker Build / Tests

- task: PublishTestResults@2
condition: succeededOrFailed()
inputs:
testResultsFiles: '**/test-*.xml'
failTaskOnFailedTests: true
testRunTitle: 'Publish test results for Python 3.7-32 bit full Linux'
testResultsFiles: 'test-data.xml'
testRunTitle: 'Linux Python 3.7 32-bit'
displayName: Publish test results
61 changes: 61 additions & 0 deletions ci/azure/macos.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
parameters:
name: ''
vmImage: ''

jobs:
- job: ${{ parameters.name }}
pool:
vmImage: ${{ parameters.vmImage }}
strategy:
matrix:
py37_macos:
ENV_FILE: ci/deps/azure-macos-37.yaml
CONDA_PY: "37"
PATTERN: "not slow and not network"

steps:
- bash: echo '##vso[task.prependpath]$CONDA/bin'
displayName: Add conda to PATH

- bash: sudo chown -R $USER $CONDA
displayName: Take ownership of conda installation

- bash: conda update --quiet --yes conda
displayName: Update conda

- bash: conda env create --quiet --file $(ENV_FILE)
displayName: Create Anaconda environment

- bash: |
eval "$(conda shell.bash hook)"
conda activate pandas-dev
conda list
python setup.py build_ext -q -j 4
python -m pip install -e . --no-build-isolation --no-use-pep517
displayName: Build pandas

- bash: |
eval "$(conda shell.bash hook)"
conda activate pandas-dev
ci/run_tests.sh
displayName: Test

- bash: |
eval "$(conda shell.bash hook)"
conda activate pandas-dev
python -c "import pandas; pandas.show_versions();"
displayName: Build versions

- task: PublishTestResults@2
condition: succeededOrFailed()
inputs:
failTaskOnFailedTests: true
testResultsFiles: 'test-data.xml'
testRunTitle: ${{ format('{0}-$(CONDA_PY)', parameters.name) }}
displayName: Publish test results

- bash: |
eval "$(conda shell.bash hook)"
conda activate pandas-dev
python ci/print_skipped.py
displayName: Print skipped tests
43 changes: 0 additions & 43 deletions ci/azure/posix.yml

This file was deleted.

41 changes: 24 additions & 17 deletions ci/azure/windows.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,49 +9,56 @@ jobs:
strategy:
matrix:
py37_np17:
ENV_FILE: ci/deps/azure-windows-37.yaml
ENV_FILE: ci\\deps\\azure-windows-37.yaml
CONDA_PY: "37"
PATTERN: "not slow and not network"

py38_np18:
ENV_FILE: ci/deps/azure-windows-38.yaml
ENV_FILE: ci\\deps\\azure-windows-38.yaml
CONDA_PY: "38"
PATTERN: "not slow and not network and not high_memory"

steps:
- powershell: |
Write-Host "##vso[task.prependpath]$env:CONDA\Scripts"
Write-Host "##vso[task.prependpath]$HOME/miniconda3/bin"
displayName: 'Add conda to PATH'
displayName: Add conda to PATH

- script: conda update -q -n base conda
displayName: 'Update conda'
- script: conda update --quiet --yes conda
displayName: Update conda

- bash: |
conda env create -q --file ci\\deps\\azure-windows-$(CONDA_PY).yaml
displayName: 'Create anaconda environment'
- script: conda env create --quiet --file $(ENV_FILE)
displayName: Create anaconda environment

- bash: |
source activate pandas-dev
eval "$(conda shell.bash hook)"
conda activate pandas-dev
conda list
python setup.py build_ext -q -j 4
python -m pip install --no-build-isolation -e .
displayName: 'Build'
python -m pip install -e . --no-build-isolation --no-use-pep517
displayName: Build pandas

- bash: |
source activate pandas-dev
eval "$(conda shell.bash hook)"
conda activate pandas-dev
ci/run_tests.sh
displayName: 'Test'
displayName: Test

- bash: |
eval "$(conda shell.bash hook)"
conda activate pandas-dev
python -c "import pandas; pandas.show_versions();"
displayName: Build versions

- task: PublishTestResults@2
condition: succeededOrFailed()
inputs:
failTaskOnFailedTests: true
testResultsFiles: 'test-data.xml'
testRunTitle: ${{ format('{0}-$(CONDA_PY)', parameters.name) }}
displayName: 'Publish test results'
displayName: Publish test results

- bash: |
source activate pandas-dev
eval "$(conda shell.bash hook)"
conda activate pandas-dev
python ci/print_skipped.py
displayName: 'Print skipped tests'
displayName: Print skipped tests