Skip to content

PERF: performance gains in DataFrame groupby.transform for ufuncs (GH7383) #7463

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jun 16, 2014

Conversation

jreback
Copy link
Contributor

@jreback jreback commented Jun 14, 2014

accelerates non-modifying transformations, e.g.
closes #7383

DataFrame.groupby(...).transform(np.max)

-------------------------------------------------------------------------------
Test name                                    | head[ms] | base[ms] |  ratio   |
-------------------------------------------------------------------------------
groupby_transform_ufunc                      |   6.1977 | 215.6494 |   0.0287 |
groupby_transform2                           | 155.9653 | 155.1824 |   1.0050 |
groupby_transform                            | 167.5134 | 165.7823 |   1.0104 |
-------------------------------------------------------------------------------
Test name                                    | head[ms] | base[ms] |  ratio   |
-------------------------------------------------------------------------------

Ratio < 1.0 means the target commit is faster then the baseline.
Seed used: 1234

Target [3d3715b] : WPI: fast tranform on DataFrame
Base   [eb1ae6b] : Merge pull request #7458 from sinhrks/intersection

@jreback jreback added this to the 0.14.1 milestone Jun 14, 2014
jreback added a commit that referenced this pull request Jun 16, 2014
PERF: performance gains in DataFrame groupby.transform for ufuncs (GH7383)
@jreback jreback merged commit be2db88 into pandas-dev:master Jun 16, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Groupby Performance Memory or execution speed performance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

transform function is very slow in 0.14 - similar to issue #2121
1 participant