Skip to content

BUG: Don't parse NA-values in index when requested #18127

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Nov 6, 2017

Conversation

gfyoung
Copy link
Member

@gfyoung gfyoung commented Nov 5, 2017

The na_filter parameter wasn't being respected when being applied on values in the index.

Closes #5239.

@gfyoung gfyoung added Bug IO CSV read_csv, to_csv Missing-data np.nan, pd.NaT, pd.NA, dropna, isnull, interpolate labels Nov 5, 2017
@gfyoung gfyoung added this to the 0.21.1 milestone Nov 5, 2017
@gfyoung
Copy link
Member Author

gfyoung commented Nov 5, 2017

sure.....though to be honest, easiest just to drop na_filter...but if you come up with a better API, gr8

@jreback : I agree with this suggestion. I could also deprecate the parameter in this PR as well?

@codecov
Copy link

codecov bot commented Nov 6, 2017

Codecov Report

Merging #18127 into master will decrease coverage by 0.01%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #18127      +/-   ##
==========================================
- Coverage   91.28%   91.26%   -0.02%     
==========================================
  Files         163      163              
  Lines       50127    50130       +3     
==========================================
- Hits        45757    45752       -5     
- Misses       4370     4378       +8
Flag Coverage Δ
#multiple 89.07% <100%> (ø) ⬆️
#single 40.32% <66.66%> (-0.06%) ⬇️
Impacted Files Coverage Δ
pandas/io/parsers.py 95.59% <100%> (+0.07%) ⬆️
pandas/io/gbq.py 25% <0%> (-58.34%) ⬇️
pandas/core/frame.py 97.75% <0%> (-0.1%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6f0ff1a...fdb6ef3. Read the comment docs.

@@ -79,6 +79,7 @@ I/O

- Bug in class:`~pandas.io.stata.StataReader` not converting date/time columns with display formatting addressed (:issue:`17990`). Previously columns with display formatting were normally left as ordinal numbers and not converted to datetime objects.
- Bug in :func:`read_csv` when reading a compressed UTF-16 encoded file (:issue:`18071`)
- Bug in :func:`read_csv` when specifying null-value handling on index columns (:issue:`5239`)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe mention na_filter here

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep, done.

@jreback
Copy link
Contributor

jreback commented Nov 6, 2017

minor comment. merge when pushed and on green.

@gfyoung
Copy link
Member Author

gfyoung commented Nov 6, 2017

All is green, so merging.

@gfyoung gfyoung merged commit c176a3c into pandas-dev:master Nov 6, 2017
@gfyoung gfyoung deleted the index-na-filter branch November 7, 2017 03:38
watercrossing pushed a commit to watercrossing/pandas that referenced this pull request Nov 10, 2017
No-Stream pushed a commit to No-Stream/pandas that referenced this pull request Nov 28, 2017
TomAugspurger pushed a commit to TomAugspurger/pandas that referenced this pull request Dec 8, 2017
TomAugspurger pushed a commit that referenced this pull request Dec 11, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug IO CSV read_csv, to_csv Missing-data np.nan, pd.NaT, pd.NA, dropna, isnull, interpolate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants