Skip to content

BUG: fix reading pre-0.14.1 pickles of containers with one block and dup items #7794

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

immerrr
Copy link
Contributor

@immerrr immerrr commented Jul 18, 2014

Series, frames and panels that contain only one block can be unpickled
under the assumption that block items correspond to manager items 1-to-1
(as pointed out in #7329).

I still don't have any of darwin/win/32bit platforms at hand, so I
cannot post those pickles. Also, my linux has a fresher python than
indicated by filenames of existing pickle test data. I did generate
some data to test the fix, the question is do you want me to upload it?

@immerrr immerrr changed the title Fix unpickling series with non unique index BUG: fix reading pre-0.14.1 pickles of containers with one block and non-unique items Jul 18, 2014
@immerrr immerrr changed the title BUG: fix reading pre-0.14.1 pickles of containers with one block and non-unique items BUG: fix reading pre-0.14.1 pickles of containers with one block and dup items Jul 18, 2014
@jreback
Copy link
Contributor

jreback commented Jul 18, 2014

just put up some legacy files whatever your python / platform (if u want to multiple versions of oython that's ok)

it doesn't matter much that we have for every platform for very version

cross compat is pretty much there

@immerrr
Copy link
Contributor Author

immerrr commented Jul 18, 2014

Ok, I've added pickles for 0.13.0, 0.14.0 (just in case) and 0.14.1.

@jreback jreback added the Compat label Jul 18, 2014
@jreback jreback added this to the 0.15.0 milestone Jul 18, 2014
@jreback
Copy link
Contributor

jreback commented Jul 18, 2014

perfect! ping when green

@jreback
Copy link
Contributor

jreback commented Jul 18, 2014

you have to add the directory of 0.14.0 to setup.py, see here: https://github.com/pydata/pandas/blob/master/setup.py#L578

(actually prob is a better way to do by adding all directories under data), any idea?

@jreback
Copy link
Contributor

jreback commented Jul 19, 2014

@immerrr pls rebase another commit added the 0.14.0 pickle dir already

immerrr added 2 commits July 20, 2014 23:21
Don't generate them for pre-0.14.1 as they cannot be unpickled.
Series, frames and panels that contain only one block can be unpickled
under the assumption that block items correspond to manager items 1-to-1.
@immerrr
Copy link
Contributor Author

immerrr commented Jul 20, 2014

rebased and green

jreback added a commit that referenced this pull request Jul 21, 2014
…unique-index

BUG: fix reading pre-0.14.1 pickles of containers with one block and dup items
@jreback jreback merged commit 73598c1 into pandas-dev:master Jul 21, 2014
@jreback
Copy link
Contributor

jreback commented Jul 21, 2014

@immerrr thanks for the fix! preserving pickle compat is never easy!

@immerrr immerrr deleted the fix-unpickling-series-with-non-unique-index branch July 29, 2014 10:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Compat pandas objects compatability with Numpy or Python functions
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants