-
-
Notifications
You must be signed in to change notification settings - Fork 18.4k
DOC: add warning to append about inefficiency #16956
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 1 commit
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -4618,6 +4618,11 @@ def append(self, other, ignore_index=False, verify_integrity=False): | |
the DataFrame's index, the order of the columns in the resulting | ||
DataFrame will be unchanged. | ||
|
||
Iteratively appending rows to a Dataframe can be more computationally | ||
intense than a single concatenate. A better solution is to append those | ||
rows to a list then concatenate the list with the original Dataframe | ||
all at once. | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. intense --> intensive There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. can you show some pseudo code |
||
|
||
See also | ||
-------- | ||
pandas.concat : General function to concatenate DataFrame, Series | ||
|
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -1522,6 +1522,17 @@ def append(self, to_append, ignore_index=False, verify_integrity=False): | |
verify_integrity : boolean, default False | ||
If True, raise Exception on creating index with duplicates | ||
|
||
Notes | ||
----- | ||
Iteratively appending to a series can be more computationally intense | ||
than a single concatenate. A better solution is to append values to a | ||
list then concatenate the list with the original series all at once. | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. series --> Series |
||
|
||
See also | ||
-------- | ||
pandas.concat : General function to concatenate DataFrame, Series | ||
or Panel objects | ||
|
||
Returns | ||
------- | ||
appended : Series | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why this
try
-except
here?There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This was to fix an issue if a doc build failed halfway through due to a missing dependency or ^C. I worked on this fix with @TomAugspurger, but am no longer to reproduce it's success. I am removing it from further pull requests.