Skip to content

[PERF] fixing memory leak in aggregation.pyx #44032

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Oct 16, 2021

Conversation

realead
Copy link
Contributor

@realead realead commented Oct 14, 2021

The old memory needs to be released, before the pointer switches to the new list.

Copy link
Member

@mroeschke mroeschke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just need a whatsnew note (for v1.4), otherwise LGTM

@mroeschke mroeschke added Performance Memory or execution speed performance Window rolling, ewma, expanding labels Oct 15, 2021
@mroeschke mroeschke added this to the 1.4 milestone Oct 15, 2021
@@ -508,6 +508,7 @@ Groupby/resample/rolling
- Fixed bug in :meth:`Series.rolling` and :meth:`DataFrame.rolling` not calculating window bounds correctly for the first row when ``center=True`` and index is decreasing (:issue:`43927`)
- Bug in :meth:`GroupBy.nth` failing on ``axis=1`` (:issue:`43926`)
- Fixed bug in :meth:`Series.rolling` and :meth:`DataFrame.rolling` not respecting right bound on centered datetime-like windows, if the index contain duplicates (:issue:`#3944`)
- Fixed memory leaks in :func:`roll_quantile` and :func:`roll_median_c` (:issue:`#43339`)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nits:

:meth:`Series.rolling.quantile` and :meth:`Series.rolling.median`

No need for a # next to the issue number.

@jreback jreback modified the milestones: 1.4, 1.3.4 Oct 16, 2021
@jreback
Copy link
Contributor

jreback commented Oct 16, 2021

would be ok including this in 1.3.x if you can move the note

@realead realead force-pushed the fix_leak_aggregations branch from fa3a5d0 to e0967cb Compare October 16, 2021 16:43
@jreback
Copy link
Contributor

jreback commented Oct 16, 2021

cc @simonjayhawkins ok to include this for 1.3.4

@simonjayhawkins
Copy link
Member

cc @simonjayhawkins ok to include this for 1.3.4

sure.

@jreback jreback merged commit 0638f7f into pandas-dev:master Oct 16, 2021
@jreback
Copy link
Contributor

jreback commented Oct 16, 2021

thanks @realead

@jreback
Copy link
Contributor

jreback commented Oct 16, 2021

@meeseeksdev backport 1.3.x

@lumberbot-app
Copy link

lumberbot-app bot commented Oct 16, 2021

Something went wrong ... Please have a look at my logs.

jreback pushed a commit that referenced this pull request Oct 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Performance Memory or execution speed performance Window rolling, ewma, expanding
Projects
None yet
Development

Successfully merging this pull request may close these issues.

BUG: skiplist memory leak in rolling functions
4 participants