Skip to content

Commit 00d7225

Browse files
bolkedebruinCloud Composer Team
authored and
Cloud Composer Team
committed
Remove upper bound constraint on aiobotocore (#36031)
s3fs has significantly relaxed its dependency requirements, so we can now safely remove the upper bound constraint and lower the the minimum required. GitOrigin-RevId: 9bd192eb0aad2994b07854734011625a0c6189c5
1 parent 83b3b1f commit 00d7225

File tree

1 file changed

+1
-13
lines changed

1 file changed

+1
-13
lines changed

Dockerfile.ci

Lines changed: 1 addition & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1229,19 +1229,7 @@ RUN echo "Airflow version: ${AIRFLOW_VERSION}"
12291229
# conflict when we do not limit it. It seems that `pip` has a hard time figuring the right
12301230
# combination of dependencies for aiobotocore, botocore, boto3 and s3fs together
12311231
#
1232-
# The root cause of the problem is that botocore (1.33.2), boto3 (1.33.2), aibotocore (2.8.0) all
1233-
# released on November 28/29 2023. They are all compatible with each other but they
1234-
# do not have corresponding s3fs release that would be compatible with them. The
1235-
# s3fs latest 2023.10.0 release has iobotocore ~=2.7.0 which effectively forbids it to use 2.8.0
1236-
# (and friends) and it confuses `pip` enough that it's not able to figure out that latest s3fs has a working
1237-
# combination of aibotocore,botocore,boto3,s3fs - and it either gets into conflict or backtracks for hours.
1238-
#
1239-
# We need to help `pip` a little bit by limiting
1240-
# limiting aiobotocore (limiting s3fs to latest version causes conflict)
1241-
# This limit should be removed once new version of s3fs is released that is compatible with
1242-
# aiobotocore 2.8.0 (beyond 2023.10.0).
1243-
#
1244-
ARG EAGER_UPGRADE_ADDITIONAL_REQUIREMENTS="grpcio-status>=1.55.0 aiobotocore>=2.7.0,<2.8.0"
1232+
ARG EAGER_UPGRADE_ADDITIONAL_REQUIREMENTS="grpcio-status>=1.55.0 aiobotocore>=2.5.4"
12451233
ARG UPGRADE_TO_NEWER_DEPENDENCIES="false"
12461234
ARG VERSION_SUFFIX_FOR_PYPI=""
12471235

0 commit comments

Comments
 (0)