Skip to content

Apply min_itemsize to index even when not appending #14812

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 3 commits into from

Conversation

toobaz
Copy link
Member

@toobaz toobaz commented Dec 6, 2016

@toobaz toobaz changed the title To hdf min itemsize Apply min_itemsize to index even when not appending Dec 6, 2016
@@ -1372,6 +1372,22 @@ def check_col(key, name, size):
min_itemsize={'index': 4})
tm.assert_series_equal(store.select('ss2'), df['B'])

# min_itemsize in index of DataFrame.to_hdf() (GH 10381)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use the existing patter.

don't use store.filename

Copy link
Member Author

@toobaz toobaz Dec 6, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, replaced with store.put() or .append().

@jreback jreback added the IO HDF5 read_hdf, HDFStore label Dec 6, 2016
@toobaz toobaz force-pushed the to_hdf_min_itemsize branch from e5a421e to cc138d9 Compare December 6, 2016 22:22
@jreback
Copy link
Contributor

jreback commented Dec 6, 2016

can you add a replica of @TomAugspurger example as well (you can make a new test function is fine). Just to cover the bases.

@jreback
Copy link
Contributor

jreback commented Dec 6, 2016

otherwise lgtm.

@jreback jreback added the Bug label Dec 6, 2016
@toobaz toobaz force-pushed the to_hdf_min_itemsize branch from cc138d9 to fffee0f Compare December 7, 2016 07:19
@codecov-io
Copy link

codecov-io commented Dec 7, 2016

Current coverage is 85.26% (diff: 100%)

Merging #14812 into master will decrease coverage by <.01%

@@             master     #14812   diff @@
==========================================
  Files           144        144          
  Lines         50981      50980     -1   
  Methods           0          0          
  Messages          0          0          
  Branches          0          0          
==========================================
- Hits          43470      43469     -1   
  Misses         7511       7511          
  Partials          0          0          

Powered by Codecov. Last update 81a2f79...c07f1e4

@toobaz toobaz force-pushed the to_hdf_min_itemsize branch from fffee0f to 29a4000 Compare December 7, 2016 07:40
@toobaz
Copy link
Member Author

toobaz commented Dec 7, 2016

Appveyor is stuck again

@jreback
Copy link
Contributor

jreback commented Dec 10, 2016

rebase again, problem with appeveyor which i just fixed

@toobaz toobaz force-pushed the to_hdf_min_itemsize branch from 29a4000 to c07f1e4 Compare December 11, 2016 01:15
@jorisvandenbossche jorisvandenbossche added this to the 0.19.2 milestone Dec 11, 2016
@jreback jreback closed this in e833096 Dec 11, 2016
@toobaz toobaz deleted the to_hdf_min_itemsize branch December 12, 2016 00:12
jorisvandenbossche pushed a commit that referenced this pull request Dec 15, 2016
closes #10381

Author: Pietro Battiston <[email protected]>

Closes #14812 from toobaz/to_hdf_min_itemsize and squashes the following commits:

c07f1e4 [Pietro Battiston] Whatsnew
38b8fcc [Pietro Battiston] Tests for previous commit
c838afa [Pietro Battiston] BUG: set min_itemsize even when there is no need to validate (#10381)

(cherry picked from commit e833096)
ischurov pushed a commit to ischurov/pandas that referenced this pull request Dec 19, 2016
closes pandas-dev#10381

Author: Pietro Battiston <[email protected]>

Closes pandas-dev#14812 from toobaz/to_hdf_min_itemsize and squashes the following commits:

c07f1e4 [Pietro Battiston] Whatsnew
38b8fcc [Pietro Battiston] Tests for previous commit
c838afa [Pietro Battiston] BUG: set min_itemsize even when there is no need to validate (pandas-dev#10381)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug IO HDF5 read_hdf, HDFStore
Projects
None yet
Development

Successfully merging this pull request may close these issues.

BUG: DataFrame.to_hdf doesn't pass along min_itemsize for index
4 participants