Skip to content

Commit 4025014

Browse files
committed
Replace long What's New entry with one liner
1 parent 5f06acd commit 4025014

File tree

1 file changed

+3
-38
lines changed

1 file changed

+3
-38
lines changed

doc/source/whatsnew/v1.4.0.rst

+3-38
Original file line numberDiff line numberDiff line change
@@ -125,6 +125,7 @@ Other enhancements
125125
- Attempting to write into a file in missing parent directory with :meth:`DataFrame.to_csv`, :meth:`DataFrame.to_html`, :meth:`DataFrame.to_excel`, :meth:`DataFrame.to_feather`, :meth:`DataFrame.to_parquet`, :meth:`DataFrame.to_stata`, :meth:`DataFrame.to_json`, :meth:`DataFrame.to_pickle`, and :meth:`DataFrame.to_xml` now explicitly mentions missing parent directory, the same is true for :class:`Series` counterparts (:issue:`24306`)
126126
- :meth:`IntegerArray.all` , :meth:`IntegerArray.any`, :meth:`FloatingArray.any`, and :meth:`FloatingArray.all` use Kleene logic (:issue:`41967`)
127127
- Added support for nullable boolean and integer types in :meth:`DataFrame.to_stata`, :class:`~pandas.io.stata.StataWriter`, :class:`~pandas.io.stata.StataWriter117`, and :class:`~pandas.io.stata.StataWriterUTF8` (:issue:`40855`)
128+
- :meth:`DataFrame.to_parquet` now writes Parquet compliant data for columns which contain lists or arrays when using PyArrow 4.0.0 or greater (:issue:`43689`)
128129
-
129130

130131
.. ---------------------------------------------------------------------------
@@ -186,45 +187,9 @@ Now the float-dtype is respected. Since the common dtype for these DataFrames is
186187
187188
res
188189
189-
.. _whatsnew_140.notable_bug_fixes.write_compliant_parquet_nested_type:
190+
.. _whatsnew_140.notable_bug_fixes.notable_bug_fix3:
190191

191-
Write compliant Parquet nested types if possible
192-
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
193-
194-
When using :meth:`DataFrame.to_parquet` to write a DataFrame to Parquet, if any of the columns contained arrays
195-
of values the :mod:`pyarrow` engine would write a non-compliant format. This behavior is now fixed when the installed
196-
version of PyArrow is at least ``4.0.0``.
197-
198-
https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#nested-types
199-
200-
.. ipython:: python
201-
202-
import pandas as pd
203-
import pyarrow.parquet as pq
204-
205-
df = pd.DataFrame({"int_array_col": [[1, 2, 3], [4, 5, 6]]})
206-
df.to_parquet("/tmp/sample_df")
207-
parquet_table = pq.read_table("/tmp/sample_df")
208-
209-
*Previous behavior*:
210-
211-
.. code-block:: ipython
212-
213-
In [4]: parquet_table.schema.types
214-
Out[4]:
215-
[ListType(list<item: int64>)]
216-
217-
*New behavior*:
218-
219-
.. code-block:: ipython
220-
221-
In [4]: parquet_table.schema.types
222-
Out[4]:
223-
[ListType(list<element: int64>)]
224-
225-
.. _whatsnew_140.notable_bug_fixes.notable_bug_fix4:
226-
227-
notable_bug_fix4
192+
notable_bug_fix3
228193
^^^^^^^^^^^^^^^^
229194

230195
.. ---------------------------------------------------------------------------

0 commit comments

Comments
 (0)