Skip to content

CI, ENH: Check each minimum dependency is enforced in *.yaml and environment.yml #51189

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 45 commits into from
Feb 23, 2023
Merged

CI, ENH: Check each minimum dependency is enforced in *.yaml and environment.yml #51189

Show file tree
Hide file tree
Changes from 34 commits
Commits
Show all changes
45 commits
Select commit Hold shift + click to select a range
4a15e02
Add pin_min_versions_to_ci_deps()
kathleenhang Feb 1, 2023
f71a869
Fix typos
kathleenhang Feb 1, 2023
e4b90a2
Remove debug statements
kathleenhang Feb 1, 2023
527bd37
Update YAML package versions
kathleenhang Feb 2, 2023
cbd87e5
Replace files with updated min versions
kathleenhang Feb 3, 2023
c0c4ffc
Add exclusions + edge cases
kathleenhang Feb 6, 2023
e4789d2
Revert file to original
kathleenhang Feb 6, 2023
1c8c8b4
Revert environment.yml
kathleenhang Feb 7, 2023
6d6c391
Fix bugs
kathleenhang Feb 9, 2023
7b3f50a
Merge branch 'main' into kathleenhang-50207
kathleenhang Feb 9, 2023
a4b4bdb
Add helper function
kathleenhang Feb 9, 2023
e2bb536
Ran pre-commit run validate-min-versions-in-sync --all-files
kathleenhang Feb 9, 2023
8397c94
Merge branch 'kathleenhang-50207' of https://github.com/kathleenhang/…
kathleenhang Feb 9, 2023
3a73573
Fix merge issue
kathleenhang Feb 9, 2023
ed4827b
Merge branch 'main' into kathleenhang-50207
kathleenhang Feb 9, 2023
0968c10
add parameter for custom toml dependency
kathleenhang Feb 15, 2023
6d30e63
Add dummy test files for test_validate_min_versions_in_sync.py
kathleenhang Feb 15, 2023
f923b98
Add unit test: test_update_yaml_file_version()
kathleenhang Feb 15, 2023
49e00c6
Merge branch 'kathleenhang-50207' of https://github.com/kathleenhang/…
kathleenhang Feb 15, 2023
536450f
Merge branch 'main' into kathleenhang-50207
kathleenhang Feb 15, 2023
1431ae8
Add dummy test files for edge cases
kathleenhang Feb 15, 2023
d2d5d73
Add parametrization to unit test
kathleenhang Feb 15, 2023
1af6771
Run pre-commit
kathleenhang Feb 15, 2023
3b6123f
Fix tzdata bug
kathleenhang Feb 15, 2023
2c8c746
Merge branch 'kathleenhang-50207' of https://github.com/kathleenhang/…
kathleenhang Feb 15, 2023
4af5291
Fix tzdata issue
kathleenhang Feb 15, 2023
6e8b0ef
Merge branch 'main' into kathleenhang-50207
kathleenhang Feb 15, 2023
5bd4908
Refactor
kathleenhang Feb 20, 2023
78114fb
Merge branch 'kathleenhang-50207' of https://github.com/kathleenhang/…
kathleenhang Feb 20, 2023
04dda2e
Update ci deps
kathleenhang Feb 20, 2023
db0feae
Remove pyarrow
kathleenhang Feb 20, 2023
4bd6e7a
Revert tzdata
kathleenhang Feb 20, 2023
bec1dd1
Update pyarrow
kathleenhang Feb 20, 2023
3c4e800
Revert pyarrow
kathleenhang Feb 20, 2023
964e201
Add docstrings
kathleenhang Feb 21, 2023
e89dd4d
Merge branch 'main' into kathleenhang-50207
kathleenhang Feb 21, 2023
47179f0
Remove psutil
kathleenhang Feb 22, 2023
2c39a81
Fix file rewrite issue
kathleenhang Feb 22, 2023
554ed85
Refactor test data
kathleenhang Feb 22, 2023
b2a672b
Merge branch 'kathleenhang-50207' of https://github.com/kathleenhang/…
kathleenhang Feb 22, 2023
985730f
minor fixups
Feb 23, 2023
0b25f3a
Merge remote-tracking branch 'upstream/main'
Feb 23, 2023
07c68b3
fixup
Feb 23, 2023
74965c2
improve typing
Feb 23, 2023
635c055
Merge branch 'main' into kathleenhang-50207
MarcoGorelli Feb 23, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .pre-commit-config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -397,7 +397,7 @@ repos:
entry: python scripts/validate_min_versions_in_sync.py
language: python
files: ^(ci/deps/actions-.*-minimum_versions\.yaml|pandas/compat/_optional\.py)$
additional_dependencies: [tomli]
additional_dependencies: [tomli, pyyaml]
- id: validate-errors-locations
name: Validate errors locations
description: Validate errors are in appropriate locations.
Expand Down
2 changes: 1 addition & 1 deletion ci/deps/actions-310-numpydev.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ dependencies:
- pytest-cov
- pytest-xdist>=2.2.0
- hypothesis>=6.34.2
- pytest-asyncio>=0.17
- pytest-asyncio>=0.17.0

# pandas dependencies
- python-dateutil
Expand Down
58 changes: 29 additions & 29 deletions ci/deps/actions-310.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ dependencies:
- pytest-cov
- pytest-xdist>=2.2.0
- psutil
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

psutil was recently removed from all of the these files. Could you remove them?

- pytest-asyncio>=0.17
- pytest-asyncio>=0.17.0
- boto3

# required dependencies
Expand All @@ -22,36 +22,36 @@ dependencies:
- pytz

# optional dependencies
- beautifulsoup4
- beautifulsoup4>=4.9.3
- blosc
- bottleneck
- brotlipy
- fastparquet
- fsspec
- html5lib
- hypothesis
- gcsfs
- jinja2
- lxml
- bottleneck>=1.3.2
- brotlipy>=0.7.0
- fastparquet>=0.6.3
- fsspec>=2021.07.0
- html5lib>=1.1
- hypothesis>=6.34.2
- gcsfs>=2021.07.0
- jinja2>=3.0.0
- lxml>=4.6.3
- matplotlib>=3.6.1, <3.7.0
- numba
- numexpr
- openpyxl<3.1.1
- odfpy
- pandas-gbq
- psycopg2
- pymysql
- pytables
- numba>=0.53.1
- numexpr>=2.7.3
- openpyxl>=3.0.7, <3.1.1
- odfpy>=1.4.1
- pandas-gbq>=0.15.0
- psycopg2>=2.8.6
- pymysql>=1.0.2
- pytables>=3.6.1
- pyarrow
- pyreadstat
- python-snappy
- pyxlsb
- pyreadstat>=1.1.2
- python-snappy>=0.6.0
- pyxlsb>=1.0.8
- s3fs>=2021.08.0
- scipy
- sqlalchemy
- tabulate
- scipy>=1.7.1
- sqlalchemy<1.4.46, >=1.4.16
- tabulate>=0.8.9
- tzdata>=2022a
- xarray
- xlrd
- xlsxwriter
- zstandard
- xarray>=0.21.0
- xlrd>=2.0.1
- xlsxwriter>=1.4.3
- zstandard>=0.15.2
56 changes: 28 additions & 28 deletions ci/deps/actions-311.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,11 +9,11 @@ dependencies:
- cython>=0.29.32

# test dependencies
- pytest>=7.0
- pytest>=7.0.0
- pytest-cov
- pytest-xdist>=2.2.0
- psutil
- pytest-asyncio>=0.17
- pytest-asyncio>=0.17.0
- boto3

# required dependencies
Expand All @@ -22,36 +22,36 @@ dependencies:
- pytz

# optional dependencies
- beautifulsoup4
- beautifulsoup4>=4.9.3
- blosc
- bottleneck
- brotlipy
- fastparquet
- fsspec
- html5lib
- hypothesis
- gcsfs
- jinja2
- lxml
- bottleneck>=1.3.2
- brotlipy>=0.7.0
- fastparquet>=0.6.3
- fsspec>=2021.07.0
- html5lib>=1.1
- hypothesis>=6.34.2
- gcsfs>=2021.07.0
- jinja2>=3.0.0
- lxml>=4.6.3
- matplotlib>=3.6.1, <3.7.0
# - numba not compatible with 3.11
- numexpr
- openpyxl<3.1.1
- odfpy
- pandas-gbq
- psycopg2
- pymysql
- numexpr>=2.7.3
- openpyxl>=3.0.7, <3.1.1
- odfpy>=1.4.1
- pandas-gbq>=0.15.0
- psycopg2>=2.8.6
- pymysql>=1.0.2
# - pytables>=3.8.0 # first version that supports 3.11
- pyarrow
- pyreadstat
- python-snappy
- pyxlsb
- pyreadstat>=1.1.2
- python-snappy>=0.6.0
- pyxlsb>=1.0.8
- s3fs>=2021.08.0
- scipy
- sqlalchemy
- tabulate
- scipy>=1.7.1
- sqlalchemy<1.4.46, >=1.4.16
- tabulate>=0.8.9
- tzdata>=2022a
- xarray
- xlrd
- xlsxwriter
- zstandard
- xarray>=0.21.0
- xlrd>=2.0.1
- xlsxwriter>=1.4.3
- zstandard>=0.15.2
60 changes: 30 additions & 30 deletions ci/deps/actions-38-downstream_compat.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ dependencies:
- pytest-cov
- pytest-xdist>=2.2.0
- psutil
- pytest-asyncio>=0.17
- pytest-asyncio>=0.17.0
- boto3

# required dependencies
Expand All @@ -23,37 +23,37 @@ dependencies:
- pytz

# optional dependencies
- beautifulsoup4
- beautifulsoup4>=4.9.3
- blosc
- brotlipy
- bottleneck
- fastparquet
- fsspec
- html5lib
- hypothesis
- gcsfs
- jinja2
- lxml
- matplotlib>=3.6.1, <3.7.0
- numba
- numexpr
- openpyxl<3.1.1
- odfpy
- psycopg2
- brotlipy>=0.7.0
- bottleneck>=1.3.2
- fastparquet>=0.6.3
- fsspec>=2021.07.0
- html5lib>=1.1
- hypothesis>=6.34.2
- gcsfs>=2021.07.0
- jinja2>=3.0.0
- lxml>=4.6.3
- matplotlib>=3.6.1
- numba>=0.53.1
- numexpr>=2.7.3
- openpyxl>=3.0.7, <3.1.1
- odfpy>=1.4.1
- psycopg2>=2.8.6
- pyarrow
- pymysql
- pyreadstat
- pytables
- python-snappy
- pyxlsb
- pymysql>=1.0.2
- pyreadstat>=1.1.2
- pytables>=3.6.1
- python-snappy>=0.6.0
- pyxlsb>=1.0.8
- s3fs>=2021.08.0
- scipy
- sqlalchemy
- tabulate
- xarray
- xlrd
- xlsxwriter
- zstandard
- scipy>=1.7.1
- sqlalchemy>=1.4.16
- tabulate>=0.8.9
- xarray>=0.21.0
- xlrd>=2.0.1
- xlsxwriter>=1.4.3
- zstandard>=0.15.2

# downstream packages
- botocore
Expand All @@ -66,6 +66,6 @@ dependencies:
- statsmodels
- coverage
- pandas-datareader
- pandas-gbq
- pandas-gbq>=0.15.0
- pyyaml
- py
2 changes: 1 addition & 1 deletion ci/deps/actions-38-minimum_versions.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ dependencies:
- pytest-cov
- pytest-xdist>=2.2.0
- psutil
- pytest-asyncio>=0.17
- pytest-asyncio>=0.17.0
- boto3

# required dependencies
Expand Down
58 changes: 29 additions & 29 deletions ci/deps/actions-38.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ dependencies:
- pytest-cov
- pytest-xdist>=2.2.0
- psutil
- pytest-asyncio>=0.17
- pytest-asyncio>=0.17.0
- boto3

# required dependencies
Expand All @@ -22,35 +22,35 @@ dependencies:
- pytz

# optional dependencies
- beautifulsoup4
- beautifulsoup4>=4.9.3
- blosc
- bottleneck
- brotlipy
- fastparquet
- fsspec
- html5lib
- hypothesis
- gcsfs
- jinja2
- lxml
- bottleneck>=1.3.2
- brotlipy>=0.7.0
- fastparquet>=0.6.3
- fsspec>=2021.07.0
- html5lib>=1.1
- hypothesis>=6.34.2
- gcsfs>=2021.07.0
- jinja2>=3.0.0
- lxml>=4.6.3
- matplotlib>=3.6.1, <3.7.0
- numba
- numexpr
- openpyxl<3.1.1
- odfpy
- pandas-gbq
- psycopg2
- numba>=0.53.1
- numexpr>=2.7.3
- openpyxl>=3.0.7, <3.1.1
- odfpy>=1.4.1
- pandas-gbq>=0.15.0
- psycopg2>=2.8.6
- pyarrow
- pymysql
- pyreadstat
- pytables
- python-snappy
- pyxlsb
- pymysql>=1.0.2
- pyreadstat>=1.1.2
- pytables>=3.6.1
- python-snappy>=0.6.0
- pyxlsb>=1.0.8
- s3fs>=2021.08.0
- scipy
- sqlalchemy
- tabulate
- xarray
- xlrd
- xlsxwriter
- zstandard
- scipy>=1.7.1
- sqlalchemy>=1.4.16
- tabulate>=0.8.9
- xarray>=0.21.0
- xlrd>=2.0.1
- xlsxwriter>=1.4.3
- zstandard>=0.15.2
Loading