Skip to content

Clean up construction of Series with dictionary and datetime index #14895

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 2 commits into from

Conversation

nateyoder
Copy link
Contributor

@nateyoder nateyoder commented Dec 16, 2016

Fix usage of fast_multiget with index which was always throwing an exception that was then caught; add ASV that show slight improvement

…ception that was then caught; add ASV that show slight improvement
@sinhrks sinhrks added Performance Memory or execution speed performance Datetime Datetime data dtype labels Dec 16, 2016
@sinhrks
Copy link
Member

sinhrks commented Dec 16, 2016

Thx for the PR! can u paste the vbench result?

@jreback
Copy link
Contributor

jreback commented Dec 16, 2016

lgtm. pls add a whatsnew in 0.19.2 (perf section).

@jreback jreback added this to the 0.19.2 milestone Dec 16, 2016
@nateyoder
Copy link
Contributor Author

asv continuous -f 1.1 upstream/master HEAD -b series_methods.series_constructor_dict_data_datetime_index
· Creating environments
· Discovering benchmarks
·· Uninstalling from conda-py2.7-Cython-matplotlib-numexpr-numpy-openpyxl-pytables-scipy-sqlalchemy-xlrd-xlsxwriter-xlwt
·· Installing into conda-py2.7-Cython-matplotlib-numexpr-numpy-openpyxl-pytables-scipy-sqlalchemy-xlrd-xlsxwriter-xlwt..
· Running 2 total benchmarks (2 commits * 1 environments * 1 benchmarks)
[ 0.00%] · For pandas commit hash 5f05fdc:
[ 0.00%] ·· Building for conda-py2.7-Cython-matplotlib-numexpr-numpy-openpyxl-pytables-scipy-sqlalchemy-xlrd-xlsxwriter-xlwt..
[ 0.00%] ·· Benchmarking conda-py2.7-Cython-matplotlib-numexpr-numpy-openpyxl-pytables-scipy-sqlalchemy-xlrd-xlsxwriter-xlwt
[ 50.00%] ··· Running ...x.time_series_constructor_no_data_datetime_index 3.21s
[ 50.00%] · For pandas commit hash 3ba2cff:
[ 50.00%] ·· Building for conda-py2.7-Cython-matplotlib-numexpr-numpy-openpyxl-pytables-scipy-sqlalchemy-xlrd-xlsxwriter-xlwt..
[ 50.00%] ·· Benchmarking conda-py2.7-Cython-matplotlib-numexpr-numpy-openpyxl-pytables-scipy-sqlalchemy-xlrd-xlsxwriter-xlwt
[100.00%] ··· Running ...x.time_series_constructor_no_data_datetime_index 3.78s before after ratio
[3ba2cff] [5f05fdc]

  • 3.78s      3.21s      0.85  series_methods.series_constructor_dict_data_datetime_index.time_series_constructor_no_data_datetime_index
    

SOME BENCHMARKS HAVE CHANGED SIGNIFICANTLY.

@codecov-io
Copy link

codecov-io commented Dec 16, 2016

Current coverage is 85.31% (diff: 100%)

Merging #14895 into master will increase coverage by <.01%

@@             master     #14895   diff @@
==========================================
  Files           144        144          
  Lines         51016      51015     -1   
  Methods           0          0          
  Messages          0          0          
  Branches          0          0          
==========================================
  Hits          43522      43522          
+ Misses         7494       7493     -1   
  Partials          0          0          

Powered by Codecov. Last update 3ba2cff...56be091

goal_time = 0.2

def setup(self):
self.dr = pd.date_range(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you make this 1/10th the size (it will still show the differences), just generally don't want to have have 3 second functions. ping when you push as the rest is ok.

@jreback jreback closed this in e503d40 Dec 17, 2016
@jreback
Copy link
Contributor

jreback commented Dec 17, 2016

thanks! (I adjusted the asv slightly)

ischurov pushed a commit to ischurov/pandas that referenced this pull request Dec 19, 2016
closes pandas-dev#14894
Fix usage of fast_multiget with index which was always throwing an
exception that was then caught; add ASV that show slight improvement

Author: Nate Yoder <[email protected]>

Closes pandas-dev#14895 from nateyoder/series_dict_index and squashes the following commits:

56be091 [Nate Yoder] Update whatsnew and fix pep8 issue
5f05fdc [Nate Yoder] Fix usage of fast_multiget with index which was always throwing an exception that was then caught; add ASV that show slight improvement
jorisvandenbossche pushed a commit to jorisvandenbossche/pandas that referenced this pull request Dec 24, 2016
closes pandas-dev#14894
Fix usage of fast_multiget with index which was always throwing an
exception that was then caught; add ASV that show slight improvement

Author: Nate Yoder <[email protected]>

Closes pandas-dev#14895 from nateyoder/series_dict_index and squashes the following commits:

56be091 [Nate Yoder] Update whatsnew and fix pep8 issue
5f05fdc [Nate Yoder] Fix usage of fast_multiget with index which was always throwing an exception that was then caught; add ASV that show slight improvement

(cherry picked from commit e503d40)
ShaharBental pushed a commit to ShaharBental/pandas that referenced this pull request Dec 26, 2016
closes pandas-dev#14894
Fix usage of fast_multiget with index which was always throwing an
exception that was then caught; add ASV that show slight improvement

Author: Nate Yoder <[email protected]>

Closes pandas-dev#14895 from nateyoder/series_dict_index and squashes the following commits:

56be091 [Nate Yoder] Update whatsnew and fix pep8 issue
5f05fdc [Nate Yoder] Fix usage of fast_multiget with index which was always throwing an exception that was then caught; add ASV that show slight improvement
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Datetime Datetime data dtype Performance Memory or execution speed performance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Improve the performance of instantiating a Series object with dictionary data and a datetimeindex
4 participants