Skip to content

DOC: Added an example of pitfalls when using astype #13278

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 6 commits into from
Closed

DOC: Added an example of pitfalls when using astype #13278

Changes from 3 commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
705e1a5
DOC: Added an example of pitfalls when using astype
pfrcks May 25, 2016
f394045
DOC: Cleaned up the documentation
pfrcks May 25, 2016
e1877bf
DOC: Restructured the documentation
pfrcks May 25, 2016
278e922
DOC: Some cleaning up
pfrcks May 25, 2016
c30209d
DOC: Cleaning up
pfrcks May 26, 2016
035a177
DOC: Final touches
pfrcks May 26, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions doc/source/basics.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1726,6 +1726,28 @@ then the more *general* one will be used as the result of the operation.
# conversion of dtypes
df3.astype('float32').dtypes

Convert a subset of columns to a specified type using :meth:`~DataFrame.astype`

.. ipython:: python

df = pd.DataFrame({'a': [1,2,3], 'b': [4,5,6], 'c': [7, 8, 9]})
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

call this dft or something besides df (as that's used a lot)

df[['a','b']] = df[['a','b']].astype(np.uint8)
df
df.dtypes

.. note::

When trying to convert a subset of columns to a specified type using :meth:`~DataFrame.astype` and :meth:`~DataFrame.loc`, utilizing **:** as mask, upcasting occurs.
Copy link
Member

@jorisvandenbossche jorisvandenbossche May 26, 2016 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

utilizing **:** as mask is not needed I think (in the text), as you cannot assign columns using loc without it.


:meth:`~DataFrame.loc` tries to fit in what we are assigning to the current dtypes, while [ ] will overwrite them taking the dtype from the right hand side. Therefore the following piece of code produces the unintended result.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

double backticks around []


.. ipython:: python
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you indent this one (and the following lines) to the same level as 'When trying to convert ...', so the code example is also included in the 'note' frame


Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

flip these around showing the correct method of assignment using astype.

then you can put a ::note for the explanation. People reading this just want the answer; some want the explanation, so highliting that differently helps.

df = pd.DataFrame({'a': [1,2,3], 'b': [4,5,6], 'c': [7, 8, 9]})
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you already created the df, no need to recreate

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

df get's changed in the code example before.

df.loc[:, ['a', 'b']].astype(np.uint8).dtypes
df.loc[:, ['a', 'b']] = df.loc[:, ['a', 'b']].astype(np.uint8)
df.dtypes

object conversion
~~~~~~~~~~~~~~~~~

Expand Down