BUG: Dataframe constructor when given dict with None value #14392
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Current coverage is 85.26% (diff: 100%)
|
jreback
added
Bug
Missing-data
|
@brandonmburroughs Do you have time to update this PR according to the discussion in #14381 (so keep as None) |
jreback
reviewed
Oct 26, 2016
| @@ -5693,6 +5693,8 @@ def _homogenize(data, index, dtype=None): | |||
| else: | |||
| v = dict(v) | |||
| v = lib.fast_multiget(v, oindex.values, default=NA) | |||
| elif v is None: | |||
| v = np.nan | |||
There was a problem hiding this comment.
you can change the check where this breaks now (if subarr.ndim = 0) to
if getattr(subarr, 'ndim', 0) == 0 then it will fall into that expression where the None will be correctly inferred
There was a problem hiding this comment.
There was a problem hiding this comment.
Yes, thanks!
|
@jorisvandenbossche Yes, I'll update based upon the discussion and push the changes in the next day or so. |
brandonmburroughs
force-pushed
the
dataframe_coerce_None_to_nan
branch
from
ebb75a4 to
271c0d8
Compare
| # Dict with None value | ||
| frame_none = DataFrame(dict(a=None), index=[0]) | ||
| frame_nan = DataFrame(dict(a=[None]), index=[0]) | ||
| tm.assert_frame_equal(frame_none, frame_nan) |
There was a problem hiding this comment.
Can you add an assert to check that the value in the frame is actually None (and not np.nan)
There was a problem hiding this comment.
Good idea, added.
brandonmburroughs
force-pushed
the
dataframe_coerce_None_to_nan
branch
from
271c0d8 to
231c2e4
Compare
jorisvandenbossche
approved these changes
Oct 30, 2016
|
@brandonmburroughs Thanks a lot! |
jorisvandenbossche
pushed a commit
to jorisvandenbossche/pandas
that referenced
this pull request
Nov 2, 2016
…t with None value (pandas-dev#14392) (cherry picked from commit 60a335e)
yarikoptic
added a commit
to neurodebian/pandas
that referenced
this pull request
Nov 18, 2016
Version 0.19.1 * tag 'v0.19.1': (43 commits) RLS: v0.19.1 DOC: update whatsnew/release notes for 0.19.1 (pandas-dev#14573) [Backport pandas-dev#14545] BUG/API: Index.append with mixed object/Categorical indices (pandas-dev#14545) DOC: rst fixes [Backport pandas-dev#14567] DEPR: add deprecation warning for com.array_equivalent (pandas-dev#14567) [Backport pandas-dev#14551] PERF: casting loc to labels dtype before searchsorted (pandas-dev#14551) [Backport pandas-dev#14536] BUG: DataFrame.quantile with NaNs (GH14357) (pandas-dev#14536) [Backport pandas-dev#14520] BUG: don't close user-provided file handles in C parser (GH14418) (pandas-dev#14520) [Backport pandas-dev#14392] BUG: Dataframe constructor when given dict with None value (pandas-dev#14392) [Backport pandas-dev#14514] BUG: Don't parse inline quotes in skipped lines (pandas-dev#14514) [Bacport pandas-dev#14543] BUG: tseries ceil doc fix (pandas-dev#14543) [Backport pandas-dev#14541] DOC: Simplify the gbq integration testing procedure for contributors (pandas-dev#14541) [Backport pandas-dev#14527] BUG/ERR: raise correct error when sql driver is not installed (pandas-dev#14527) [Backport pandas-dev#14501] BUG: fix DatetimeIndex._maybe_cast_slice_bound for empty index (GH14354) (pandas-dev#14501) [Backport pandas-dev#14442] DOC: Expand on reference docs for read_json() (pandas-dev#14442) BLD: fix 3.4 build for cython to 0.24.1 [Backport pandas-dev#14492] BUG: Accept unicode quotechars again in pd.read_csv [Backport pandas-dev#14496] BLD: Support Cython 0.25 [Backport pandas-dev#14498] COMPAT/TST: fix test for range testing of negative integers to neg powers [Backport pandas-dev#14476] PERF: performance regression in Series.asof (pandas-dev#14476) ...
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
git diff upstream/master | flake8 --diff