Skip to content

Commit 7df0d39

Browse files
Prepare 2.20.1 (aws#2138)
1 parent 4669aec commit 7df0d39

21 files changed

+103
-103
lines changed

.bumpversion.cfg

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
[bumpversion]
2-
current_version = 2.20.0
2+
current_version = 2.20.1
33
commit = False
44
tag = False
55
tag_name = {new_version}

CONTRIBUTING_COMMON_ERRORS.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -13,9 +13,9 @@ Requirement already satisfied: pbr!=2.1.0,>=2.0.0 in ./.venv/lib/python3.7/site-
1313
Using legacy 'setup.py install' for python-Levenshtein, since package 'wheel' is not installed.
1414
Installing collected packages: awswrangler, python-Levenshtein
1515
Attempting uninstall: awswrangler
16-
Found existing installation: awswrangler 2.20.0
17-
Uninstalling awswrangler-2.20.0:
18-
Successfully uninstalled awswrangler-2.20.0
16+
Found existing installation: awswrangler 2.20.1
17+
Uninstalling awswrangler-2.20.1:
18+
Successfully uninstalled awswrangler-2.20.1
1919
Running setup.py develop for awswrangler
2020
Running setup.py install for python-Levenshtein ... error
2121
ERROR: Command errored out with exit status 1:

README.md

Lines changed: 37 additions & 37 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q
1111

1212
> An [AWS Professional Service](https://aws.amazon.com/professional-services/) open source initiative | [email protected]
1313
14-
[![Release](https://img.shields.io/badge/release-2.20.0-brightgreen.svg)](https://pypi.org/project/awswrangler/)
14+
[![Release](https://img.shields.io/badge/release-2.20.1-brightgreen.svg)](https://pypi.org/project/awswrangler/)
1515
[![Python Version](https://img.shields.io/badge/python-3.7%20%7C%203.8%20%7C%203.9%20%7C%203.10-brightgreen.svg)](https://anaconda.org/conda-forge/awswrangler)
1616
[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
1717
[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
@@ -26,7 +26,7 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q
2626
| **[PyPi](https://pypi.org/project/awswrangler/)** | [![PyPI Downloads](https://pepy.tech/badge/awswrangler)](https://pypi.org/project/awswrangler/) | `pip install awswrangler` |
2727
| **[Conda](https://anaconda.org/conda-forge/awswrangler)** | [![Conda Downloads](https://img.shields.io/conda/dn/conda-forge/awswrangler.svg)](https://anaconda.org/conda-forge/awswrangler) | `conda install -c conda-forge awswrangler` |
2828

29-
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
29+
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
3030
➡️ `pip install pyarrow==2 awswrangler`
3131

3232
Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](https://arrow.apache.org/powered_by/)
@@ -44,7 +44,7 @@ Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](http
4444

4545
Installation command: `pip install awswrangler`
4646

47-
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
47+
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
4848
➡️`pip install pyarrow==2 awswrangler`
4949

5050
```py3
@@ -98,17 +98,17 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3
9898

9999
## [Read The Docs](https://aws-sdk-pandas.readthedocs.io/)
100100

101-
- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/about.html)
102-
- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html)
103-
- [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#pypi-pip)
104-
- [Conda](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#conda)
105-
- [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#aws-lambda-layer)
106-
- [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#aws-glue-python-shell-jobs)
107-
- [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#aws-glue-pyspark-jobs)
108-
- [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#amazon-sagemaker-notebook)
109-
- [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#amazon-sagemaker-notebook-lifecycle)
110-
- [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#emr)
111-
- [From source](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/install.html#from-source)
101+
- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/about.html)
102+
- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html)
103+
- [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#pypi-pip)
104+
- [Conda](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#conda)
105+
- [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-lambda-layer)
106+
- [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-python-shell-jobs)
107+
- [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs)
108+
- [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook)
109+
- [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook-lifecycle)
110+
- [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr)
111+
- [From source](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#from-source)
112112
- [**Tutorials**](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials)
113113
- [001 - Introduction](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/001%20-%20Introduction.ipynb)
114114
- [002 - Sessions](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/002%20-%20Sessions.ipynb)
@@ -144,29 +144,29 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3
144144
- [032 - Lake Formation Governed Tables](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/032%20-%20Lake%20Formation%20Governed%20Tables.ipynb)
145145
- [033 - Amazon Neptune](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/033%20-%20Amazon%20Neptune.ipynb)
146146
- [034 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-Glue%20%20Data%20Quality.ipynb)
147-
- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html)
148-
- [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#amazon-s3)
149-
- [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#aws-glue-catalog)
150-
- [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#amazon-athena)
151-
- [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#aws-lake-formation)
152-
- [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#amazon-redshift)
153-
- [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#postgresql)
154-
- [MySQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#mysql)
155-
- [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#sqlserver)
156-
- [Oracle](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#oracle)
157-
- [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#data-api-redshift)
158-
- [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#data-api-rds)
159-
- [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#opensearch)
160-
- [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#amazon-neptune)
161-
- [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#dynamodb)
162-
- [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#amazon-timestream)
163-
- [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#amazon-emr)
164-
- [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#amazon-cloudwatch-logs)
165-
- [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#amazon-chime)
166-
- [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#amazon-quicksight)
167-
- [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#aws-sts)
168-
- [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#aws-secrets-manager)
169-
- [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/2.20.0/api.html#global-configurations)
147+
- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html)
148+
- [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-s3)
149+
- [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-glue-catalog)
150+
- [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-athena)
151+
- [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-lake-formation)
152+
- [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-redshift)
153+
- [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#postgresql)
154+
- [MySQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#mysql)
155+
- [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#sqlserver)
156+
- [Oracle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#oracle)
157+
- [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-redshift)
158+
- [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-rds)
159+
- [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#opensearch)
160+
- [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-neptune)
161+
- [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#dynamodb)
162+
- [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-timestream)
163+
- [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-emr)
164+
- [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-cloudwatch-logs)
165+
- [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-chime)
166+
- [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-quicksight)
167+
- [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-sts)
168+
- [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-secrets-manager)
169+
- [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#global-configurations)
170170
- [**License**](https://github.com/aws/aws-sdk-pandas/blob/main/LICENSE.txt)
171171
- [**Contributing**](https://github.com/aws/aws-sdk-pandas/blob/main/CONTRIBUTING.md)
172172

awswrangler/__metadata__.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,5 +7,5 @@
77

88
__title__: str = "awswrangler"
99
__description__: str = "Pandas on AWS."
10-
__version__: str = "2.20.0"
10+
__version__: str = "2.20.1"
1111
__license__: str = "Apache License 2.0"

awswrangler/athena/_read.py

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -715,11 +715,11 @@ def read_sql_query( # pylint: disable=too-many-arguments,too-many-locals
715715
716716
**Related tutorial:**
717717
718-
- `Amazon Athena <https://aws-sdk-pandas.readthedocs.io/en/2.20.0/
718+
- `Amazon Athena <https://aws-sdk-pandas.readthedocs.io/en/2.20.1/
719719
tutorials/006%20-%20Amazon%20Athena.html>`_
720-
- `Athena Cache <https://aws-sdk-pandas.readthedocs.io/en/2.20.0/
720+
- `Athena Cache <https://aws-sdk-pandas.readthedocs.io/en/2.20.1/
721721
tutorials/019%20-%20Athena%20Cache.html>`_
722-
- `Global Configurations <https://aws-sdk-pandas.readthedocs.io/en/2.20.0/
722+
- `Global Configurations <https://aws-sdk-pandas.readthedocs.io/en/2.20.1/
723723
tutorials/021%20-%20Global%20Configurations.html>`_
724724
725725
**There are three approaches available through ctas_approach and unload_approach parameters:**
@@ -783,7 +783,7 @@ def read_sql_query( # pylint: disable=too-many-arguments,too-many-locals
783783
/athena.html#Athena.Client.get_query_execution>`_ .
784784
785785
For a practical example check out the
786-
`related tutorial <https://aws-sdk-pandas.readthedocs.io/en/2.20.0/
786+
`related tutorial <https://aws-sdk-pandas.readthedocs.io/en/2.20.1/
787787
tutorials/024%20-%20Athena%20Query%20Metadata.html>`_!
788788
789789
@@ -1039,11 +1039,11 @@ def read_sql_table(
10391039
10401040
**Related tutorial:**
10411041
1042-
- `Amazon Athena <https://aws-sdk-pandas.readthedocs.io/en/2.20.0/
1042+
- `Amazon Athena <https://aws-sdk-pandas.readthedocs.io/en/2.20.1/
10431043
tutorials/006%20-%20Amazon%20Athena.html>`_
1044-
- `Athena Cache <https://aws-sdk-pandas.readthedocs.io/en/2.20.0/
1044+
- `Athena Cache <https://aws-sdk-pandas.readthedocs.io/en/2.20.1/
10451045
tutorials/019%20-%20Athena%20Cache.html>`_
1046-
- `Global Configurations <https://aws-sdk-pandas.readthedocs.io/en/2.20.0/
1046+
- `Global Configurations <https://aws-sdk-pandas.readthedocs.io/en/2.20.1/
10471047
tutorials/021%20-%20Global%20Configurations.html>`_
10481048
10491049
**There are two approaches to be defined through ctas_approach parameter:**
@@ -1088,7 +1088,7 @@ def read_sql_table(
10881088
/athena.html#Athena.Client.get_query_execution>`_ .
10891089
10901090
For a practical example check out the
1091-
`related tutorial <https://aws-sdk-pandas.readthedocs.io/en/2.20.0/
1091+
`related tutorial <https://aws-sdk-pandas.readthedocs.io/en/2.20.1/
10921092
tutorials/024%20-%20Athena%20Query%20Metadata.html>`_!
10931093
10941094

awswrangler/s3/_read_parquet.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -870,7 +870,7 @@ def read_parquet_table(
870870
This function MUST return a bool, True to read the partition or False to ignore it.
871871
Ignored if `dataset=False`.
872872
E.g ``lambda x: True if x["year"] == "2020" and x["month"] == "1" else False``
873-
https://aws-sdk-pandas.readthedocs.io/en/2.20.0/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
873+
https://aws-sdk-pandas.readthedocs.io/en/2.20.1/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
874874
columns : List[str], optional
875875
Names of columns to read from the file(s).
876876
validate_schema:

awswrangler/s3/_read_text.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -247,7 +247,7 @@ def read_csv(
247247
This function MUST return a bool, True to read the partition or False to ignore it.
248248
Ignored if `dataset=False`.
249249
E.g ``lambda x: True if x["year"] == "2020" and x["month"] == "1" else False``
250-
https://aws-sdk-pandas.readthedocs.io/en/2.20.0/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
250+
https://aws-sdk-pandas.readthedocs.io/en/2.20.1/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
251251
pandas_kwargs :
252252
KEYWORD arguments forwarded to pandas.read_csv(). You can NOT pass `pandas_kwargs` explicitly, just add valid
253253
Pandas arguments in the function call and awswrangler will accept it.
@@ -396,7 +396,7 @@ def read_fwf(
396396
This function MUST return a bool, True to read the partition or False to ignore it.
397397
Ignored if `dataset=False`.
398398
E.g ``lambda x: True if x["year"] == "2020" and x["month"] == "1" else False``
399-
https://aws-sdk-pandas.readthedocs.io/en/2.20.0/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
399+
https://aws-sdk-pandas.readthedocs.io/en/2.20.1/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
400400
pandas_kwargs:
401401
KEYWORD arguments forwarded to pandas.read_fwf(). You can NOT pass `pandas_kwargs` explicit, just add valid
402402
Pandas arguments in the function call and awswrangler will accept it.
@@ -549,7 +549,7 @@ def read_json(
549549
This function MUST return a bool, True to read the partition or False to ignore it.
550550
Ignored if `dataset=False`.
551551
E.g ``lambda x: True if x["year"] == "2020" and x["month"] == "1" else False``
552-
https://aws-sdk-pandas.readthedocs.io/en/2.20.0/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
552+
https://aws-sdk-pandas.readthedocs.io/en/2.20.1/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
553553
pandas_kwargs:
554554
KEYWORD arguments forwarded to pandas.read_json(). You can NOT pass `pandas_kwargs` explicit, just add valid
555555
Pandas arguments in the function call and awswrangler will accept it.

awswrangler/s3/_write_parquet.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -313,18 +313,18 @@ def to_parquet( # pylint: disable=too-many-arguments,too-many-locals,too-many-b
313313
concurrent_partitioning: bool
314314
If True will increase the parallelism level during the partitions writing. It will decrease the
315315
writing time and increase the memory usage.
316-
https://aws-sdk-pandas.readthedocs.io/en/2.20.0/tutorials/022%20-%20Writing%20Partitions%20Concurrently.html
316+
https://aws-sdk-pandas.readthedocs.io/en/2.20.1/tutorials/022%20-%20Writing%20Partitions%20Concurrently.html
317317
mode: str, optional
318318
``append`` (Default), ``overwrite``, ``overwrite_partitions``. Only takes effect if dataset=True.
319319
For details check the related tutorial:
320-
https://aws-sdk-pandas.readthedocs.io/en/2.20.0/tutorials/004%20-%20Parquet%20Datasets.html
320+
https://aws-sdk-pandas.readthedocs.io/en/2.20.1/tutorials/004%20-%20Parquet%20Datasets.html
321321
catalog_versioning : bool
322322
If True and `mode="overwrite"`, creates an archived version of the table catalog before updating it.
323323
schema_evolution : bool
324324
If True allows schema evolution (new or missing columns), otherwise a exception will be raised. True by default.
325325
(Only considered if dataset=True and mode in ("append", "overwrite_partitions"))
326326
Related tutorial:
327-
https://aws-sdk-pandas.readthedocs.io/en/2.20.0/tutorials/014%20-%20Schema%20Evolution.html
327+
https://aws-sdk-pandas.readthedocs.io/en/2.20.1/tutorials/014%20-%20Schema%20Evolution.html
328328
database : str, optional
329329
Glue/Athena catalog: Database name.
330330
table : str, optional

0 commit comments

Comments
 (0)