Skip to content

PERF: JoinUnit.is_na #36312

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Sep 12, 2020
Merged

PERF: JoinUnit.is_na #36312

merged 1 commit into from
Sep 12, 2020

Conversation

jbrockmendel
Copy link
Member

This along with #36309 gets #34683 to performance parity with master.

@@ -188,6 +191,12 @@ def _use_inf_as_na(key):
"""
inf_as_na = get_option(key)
globals()["_isna"] = partial(_isna, inf_as_na=inf_as_na)
if inf_as_na:
globals()["nan_checker"] = lambda x: ~np.isfinite(x)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

don't do it like this

use the global keyword

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is the pattern we already use a few lines up

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

really? ok for here, but we really should just use the global keyword as this is the purpose.

@jreback jreback added Missing-data np.nan, pd.NaT, pd.NA, dropna, isnull, interpolate Performance Memory or execution speed performance labels Sep 12, 2020
@jreback jreback added this to the 1.2 milestone Sep 12, 2020
@jreback jreback added the Reshaping Concat, Merge/Join, Stack/Unstack, Explode label Sep 12, 2020
@jreback jreback merged commit cb58dbb into pandas-dev:master Sep 12, 2020
@jbrockmendel jbrockmendel deleted the perf-allna branch September 12, 2020 21:29
kesmit13 pushed a commit to kesmit13/pandas that referenced this pull request Nov 2, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Missing-data np.nan, pd.NaT, pd.NA, dropna, isnull, interpolate Performance Memory or execution speed performance Reshaping Concat, Merge/Join, Stack/Unstack, Explode
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants