@@ -160,15 +160,9 @@ dtype : Type name or dict of column -> type, default ``None``
160
160
(unsupported with ``engine='python' ``). Use ``str `` or ``object `` together
161
161
with suitable ``na_values `` settings to preserve and
162
162
not interpret dtype.
163
- engine : {``'c' ``, ``'python' ``, ``'pyarrow' ``}
164
- Parser engine to use. The C and pyarrow engines are faster, while the python engine
165
- is currently more feature-complete. Multithreading is currently only supported by
166
- the pyarrow engine.
167
-
168
- .. versionadded :: 1.4.0
169
-
170
- The "pyarrow" engine was added as an *experimental * engine, and some features
171
- are unsupported, or may not work correctly, with this engine.
163
+ engine : {``'c' ``, ``'python' ``}
164
+ Parser engine to use. The C engine is faster while the Python engine is
165
+ currently more feature-complete.
172
166
converters : dict, default ``None ``
173
167
Dict of functions for converting values in certain columns. Keys can either be
174
168
integers or column labels.
@@ -1628,17 +1622,11 @@ Specifying ``iterator=True`` will also return the ``TextFileReader`` object:
1628
1622
Specifying the parser engine
1629
1623
''''''''''''''''''''''''''''
1630
1624
1631
- Pandas currently supports three engines, the C engine, the python engine, and an experimental
1632
- pyarrow engine (requires the ``pyarrow `` package). In general, the pyarrow engine is fastest
1633
- on larger workloads and is equivalent in speed to the C engine on most other workloads.
1634
- The python engine tends to be slower than the pyarrow and C engines on most workloads. However,
1635
- the pyarrow engine is much less robust than the C engine, which lacks a few features compared to the
1636
- Python engine.
1637
-
1638
- Where possible, pandas uses the C parser (specified as ``engine='c' ``), but it may fall
1639
- back to Python if C-unsupported options are specified.
1640
-
1641
- Currently, options unsupported by the C and pyarrow engines include:
1625
+ Under the hood pandas uses a fast and efficient parser implemented in C as well
1626
+ as a Python implementation which is currently more feature-complete. Where
1627
+ possible pandas uses the C parser (specified as ``engine='c' ``), but may fall
1628
+ back to Python if C-unsupported options are specified. Currently, C-unsupported
1629
+ options include:
1642
1630
1643
1631
* ``sep `` other than a single character (e.g. regex separators)
1644
1632
* ``skipfooter ``
@@ -1647,32 +1635,6 @@ Currently, options unsupported by the C and pyarrow engines include:
1647
1635
Specifying any of the above options will produce a ``ParserWarning `` unless the
1648
1636
python engine is selected explicitly using ``engine='python' ``.
1649
1637
1650
- Options that are unsupported by the pyarrow engine which are not covered by the list above include:
1651
-
1652
- * ``float_precision ``
1653
- * ``chunksize ``
1654
- * ``comment ``
1655
- * ``nrows ``
1656
- * ``thousands ``
1657
- * ``memory_map ``
1658
- * ``dialect ``
1659
- * ``warn_bad_lines ``
1660
- * ``error_bad_lines ``
1661
- * ``on_bad_lines ``
1662
- * ``delim_whitespace ``
1663
- * ``quoting ``
1664
- * ``lineterminator ``
1665
- * ``converters ``
1666
- * ``decimal ``
1667
- * ``iterator ``
1668
- * ``dayfirst ``
1669
- * ``infer_datetime_format ``
1670
- * ``verbose ``
1671
- * ``skipinitialspace ``
1672
- * ``low_memory ``
1673
-
1674
- Specifying these options with ``engine='pyarrow' `` will raise a ``ValueError ``.
1675
-
1676
1638
.. _io.remote :
1677
1639
1678
1640
Reading/writing remote files
0 commit comments