Skip to content

Allow streaming downloading, if possible #28

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
dshemetov opened this issue Mar 31, 2022 · 0 comments
Closed

Allow streaming downloading, if possible #28

dshemetov opened this issue Mar 31, 2022 · 0 comments
Labels
P3 very low priority wontfix This will not be worked on

Comments

@dshemetov
Copy link
Contributor

Regarding downloading mechanism:

  • I haven't tried any streaming libraries. The most promising from a very short search is sparklyr, which also has functions that seem relevant (or duplicative?) to epiprocess and epipredict. But I'm not sure we would want to just use pre-packaged streaming, because we have I don't think we have guarantees about ordering of API response rows across all API endpoints + because of versioning.
  • It's still worth taking a look at sparklyr for epiprocess and epipredict. (And maybe arrow as well? Although I recall arrow causing some installation problems/waits.)
  • I think delphi.epidata currently uses csv as the transfer mechanism for most/all output formats.

Originally posted by @brookslogan in #13 (comment)

See other comments in that thread as well.
@brookslogan brookslogan added the P3 very low priority label Sep 30, 2022
@dshemetov dshemetov added the wontfix This will not be worked on label May 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
P3 very low priority wontfix This will not be worked on
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@dshemetov @brookslogan