v3.0.0.rst

What's new in 3.0.0 (Month XX, 2024)

These are the changes in pandas 3.0.0. See :ref:`release` for a full changelog including other versions of pandas.

{{ header }}

Enhancements

enhancement1

enhancement2

Other enhancements

• :func:`DataFrame.to_excel` now raises an UserWarning when the character count in a cell exceeds Excel's limitation of 32767 characters (:issue:`56954`)
• :func:`read_stata` now returns datetime64 resolutions better matching those natively stored in the stata format (:issue:`55642`)

Notable bug fixes

These are bug fixes that might have notable behavior changes.

notable_bug_fix1

notable_bug_fix2

Backwards incompatible API changes

Increased minimum versions for dependencies

Some minimum supported versions of dependencies were updated. If installed, we now require:

Package	Minimum Version	Required	Changed
numpy	1.23.5	X	X

For optional libraries the general recommendation is to use the latest version. The following table lists the lowest version per library that is currently being tested throughout the development of pandas. Optional libraries below the lowest tested version may still work, but are not considered supported.

Package	New Minimum Version

See :ref:`install.dependencies` and :ref:`install.optional_dependencies` for more.

Other API changes

• 3rd party py.path objects are no longer explicitly supported in IO methods. Use :py:class:`pathlib.Path` objects instead (:issue:`57091`)
• :attr:`MultiIndex.codes`, :attr:`MultiIndex.levels`, and :attr:`MultiIndex.names` now returns a tuple instead of a FrozenList (:issue:`53531`)

Deprecations

• Deprecated :meth:`Timestamp.utcfromtimestamp`, use Timestamp.fromtimestamp(ts, "UTC") instead (:issue:`56680`)
• Deprecated :meth:`Timestamp.utcnow`, use Timestamp.now("UTC") instead (:issue:`56680`)

Removal of prior version deprecations/changes

• All arguments except the first path-like argument in IO writers are now keyword only (:issue:`54229`)
• Removed DataFrameGroupBy.grouper and SeriesGroupBy.grouper (:issue:`56521`)
• Removed DataFrameGroupby.fillna and SeriesGroupBy.fillna` (:issue:`55719`)
• Removed Index.format, use :meth:`Index.astype` with str or :meth:`Index.map` with a formatter function instead (:issue:`55439`)
• Removed axis argument from :meth:`DataFrame.groupby`, :meth:`Series.groupby`, :meth:`DataFrame.rolling`, :meth:`Series.rolling`, :meth:`DataFrame.resample`, and :meth:`Series.resample` (:issue:`51203`)
• Removed axis argument from all groupby operations (:issue:`50405`)
• Removed pandas.api.types.is_interval and pandas.api.types.is_period, use isinstance(obj, pd.Interval) and isinstance(obj, pd.Period) instead (:issue:`55264`)
• Removed pandas.io.sql.execute (:issue:`50185`)
• Removed pandas.value_counts, use :meth:`Series.value_counts` instead (:issue:`53493`)
• Removed read_gbq and DataFrame.to_gbq. Use pandas_gbq.read_gbq and pandas_gbq.to_gbq instead https://pandas-gbq.readthedocs.io/en/latest/api.html (:issue:`55525`)
• Removed deprecated argument obj in :meth:`.DataFrameGroupBy.get_group` and :meth:`.SeriesGroupBy.get_group` (:issue:`53545`)
• Removed the ArrayManager (:issue:`55043`)
• Removed the is_boolean, is_integer, is_floating, holds_integer, is_numeric, is_categorical, is_object, and is_interval attributes of :class:`Index` (:issue:`50042`)
• Removed unused arguments *args and **kwargs in :class:`Resampler` methods (:issue:`50977`)
• Unrecognized timezones when parsing strings to datetimes now raises a ValueError (:issue:`51477`)

Performance improvements

• Performance improvement in :meth:`DataFrame.join` for sorted but non-unique indexes (:issue:`56941`)
• Performance improvement in :meth:`DataFrame.join` when left and/or right are non-unique and how is "left", "right", or "inner" (:issue:`56817`)
• Performance improvement in :meth:`DataFrame.join` with how="left" or how="right" and sort=True (:issue:`56919`)
• Performance improvement in :meth:`DataFrameGroupBy.ffill`, :meth:`DataFrameGroupBy.bfill`, :meth:`SeriesGroupBy.ffill`, and :meth:`SeriesGroupBy.bfill` (:issue:`56902`)
• Performance improvement in :meth:`Index.join` by propagating cached attributes in cases where the result matches one of the inputs (:issue:`57023`)
• Performance improvement in :meth:`Index.take` when indices is a full range indexer from zero to length of index (:issue:`56806`)
• Performance improvement in :meth:`MultiIndex.equals` for equal length indexes (:issue:`56990`)
• Performance improvement in indexing operations for string dtypes (:issue:`56997`)

Bug fixes

• Fixed bug in :meth:`DataFrame.join` inconsistently setting result index name (:issue:`55815`)
• Fixed bug in :meth:`Series.diff` allowing non-integer values for the periods argument. (:issue:`56607`)

Categorical

Datetimelike

• Bug in :func:`date_range` where the last valid timestamp would sometimes not be produced (:issue:`56134`)

Timedelta

Timezones

Numeric

• Bug in np.matmul with :class:`Index` inputs raising a TypeError (:issue:`57079`)

Conversion

• Bug in :meth:`Series.astype` might modify read-only array inplace when casting to a string dtype (:issue:`57212`)

Strings

• Bug in :meth:`Series.value_counts` would not respect sort=False for series having string dtype (:issue:`55224`)

Interval

Indexing

Missing

MultiIndex

I/O

Period

Plotting

Groupby/resample/rolling

• Bug in :meth:`.DataFrameGroupBy.quantile` when interpolation="nearest" is inconsistent with :meth:`DataFrame.quantile` (:issue:`47942`)
• Bug in :meth:`DataFrame.ewm` and :meth:`Series.ewm` when passed times and aggregation functions other than mean (:issue:`51695`)
• Bug in :meth:`.DataFrameGroupBy.groups` and :meth:`.SeriesGroupby.groups` that would not respect groupby arguments dropna and sort (:issue:`55919`, :issue:`56966`, :issue:`56851`)
• Bug in :meth:`.DataFrameGroupBy.nunique` and :meth:`.SeriesGroupBy.nunique` would fail with multiple categorical groupings when as_index=False (:issue:`52848`)
• Bug in :meth:`.DataFrameGroupBy.prod`, :meth:`.DataFrameGroupBy.any`, and :meth:`.DataFrameGroupBy.all` would result in NA values on unobserved groups; they now result in 1, False, and True respectively (:issue:`55783`)
• Bug in :meth:`.DataFrameGroupBy.value_counts` would produce incorrect results when used with some categorical and some non-categorical groupings and observed=False (:issue:`56016`)

Reshaping

Sparse

ExtensionArray

• Fixed bug in :meth:`api.types.is_datetime64_any_dtype` where a custom :class:`ExtensionDtype` would return False for array-likes (:issue:`57055`)

Styler

Other

• Bug in :meth:`DataFrame.where` where using a non-bool type array in the function would return a ValueError instead of a TypeError (:issue:`56330`)

Contributors