Skip to content

ENH: pd.read_feather/to_feather #13092

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
jreback opened this issue May 5, 2016 · 3 comments
Closed

ENH: pd.read_feather/to_feather #13092

jreback opened this issue May 5, 2016 · 3 comments
Labels
Enhancement IO Data IO issues that don't fit into a more specific label
Milestone

Comments

@jreback
Copy link
Contributor

jreback commented May 5, 2016

conda packages are now available here

so this should be straightforward. a couple of things to note.

  • should support the LocalPath/PathLib objects (easy as we do this in other read_*)
  • non-supported on windows ATM. need to skip for testing. feather-format will just raise an ImportError for now.
  • catch and re-raise for non-supported things, mainly object dtypes that are not all strings. Alternatively / maybe better to introspect these columns (via lib.infer_dtype) to prevent in the first place
  • test unicode support / encoding (not sure supported as of yet)
  • biggest issue is how / if to support Series and a DataFrame with a non-default index. As we need a facility to write/read meta-data within feather see here. Both these can simply .reset_index(), but the problem is they can be stored but we don't know on read-back what to .set_index(). Can just raise for now.
@jreback jreback added Enhancement IO Data IO issues that don't fit into a more specific label Difficulty Intermediate labels May 5, 2016
@jreback jreback added this to the 0.18.2 milestone May 5, 2016
@jreback
Copy link
Contributor Author

jreback commented May 5, 2016

@wesm

@wesm
Copy link
Member

wesm commented May 9, 2016

I'd prefer to put most of the heavy lifting in the feather Python library itself, unless you are worried about versioning synchronization issues? Of course we can have convenience APIs in pandas to import and invoke the appropriate feather functions.

@jreback
Copy link
Contributor Author

jreback commented May 9, 2016

@wesm no for sure. Just have an overlay of testing in pandas main I think.

@jorisvandenbossche jorisvandenbossche modified the milestones: 0.20.0, 0.19.0 Aug 15, 2016
jreback added a commit to jreback/pandas that referenced this issue Oct 11, 2016
jreback added a commit to jreback/pandas that referenced this issue Oct 24, 2016
jreback added a commit to jreback/pandas that referenced this issue Oct 25, 2016
jreback added a commit to jreback/pandas that referenced this issue Oct 26, 2016
jreback added a commit to jreback/pandas that referenced this issue Nov 26, 2016
jreback added a commit to jreback/pandas that referenced this issue Nov 26, 2016
jreback added a commit to jreback/pandas that referenced this issue Nov 30, 2016
jreback added a commit to jreback/pandas that referenced this issue Nov 30, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 6, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 13, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 15, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 15, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 16, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 16, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 16, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 16, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 16, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 16, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 16, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 17, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 17, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 17, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 21, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 26, 2016
jreback added a commit to jreback/pandas that referenced this issue Dec 26, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Enhancement IO Data IO issues that don't fit into a more specific label
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants