Code

ENH: add fsspec support#34266

Code

Merged

jorisvandenbossche merged 39 commits intopandas-dev:masterpandas-dev/pandas:masterfrom

martindurant:feature/add-fsspec-supportmartindurant/pandas:feature/add-fsspec-supportCopy head branch name to clipboard

Jun 23, 2020

Commits

Commits on Apr 14, 2020

• Add remote file io using fsspec.

  

  Julian de Ruiter

  committed
  94e717f

  Copy full SHA for 94e717f

Commits on May 19, 2020

• Attempt refactor and clean

  

  Martin Durant

  committed
  fd7e072

  Copy full SHA for fd7e072

Commits on May 20, 2020

• Merge branch 'master' into feature/add-fsspec-support

  

  Martin Durant

  committed
  302ba13

  Copy full SHA for 302ba13

Commits on May 21, 2020

• readd and adapt s3/gcs tests

  

  Martin Durant

  committed
  9e6d3b2

  Copy full SHA for 9e6d3b2

• remove gc from test

  

  Martin Durant

  committed
  4564c8d

  Copy full SHA for 4564c8d

• Simpler is_fsspec

  

  Martin Durant

  committed
  0654537

  Copy full SHA for 0654537

• add test

  

  Martin Durant

  committed
  8d45cbb

  Copy full SHA for 8d45cbb

Commits on May 28, 2020

• Answered most points

  

  Martin Durant

  committed
  006e736

  Copy full SHA for 006e736

• Implemented suggestions

  Show description for 724ebd8
  

  Martin Durant

  committed
  724ebd8

  Copy full SHA for 724ebd8

• lint

  

  Martin Durant

  committed
  9da1689

  Copy full SHA for 9da1689

Commits on May 29, 2020

• Add versions info

  

  Martin Durant

  committed
  a595411

  Copy full SHA for a595411

• Update some deps

  

  Martin Durant

  committed
  6dd1e92

  Copy full SHA for 6dd1e92

• issue link syntax

  

  Martin Durant

  committed
  6e13df7

  Copy full SHA for 6e13df7

Commits on Jun 2, 2020

• More specific test versions

  

  Martin Durant

  committed
  3262063

  Copy full SHA for 3262063

• Account for alternate S3 protocols, and ignore type error

  Show description for 4bc2411
  

  Martin Durant

  committed
  4bc2411

  Copy full SHA for 4bc2411

• Add comment to mypy ignore insrtuction

  

  Martin Durant

  committed
  68644ab

  Copy full SHA for 68644ab

• more mypy

  

  Martin Durant

  committed
  32bc586

  Copy full SHA for 32bc586

• more black

  

  Martin Durant

  committed
  037ef2c

  Copy full SHA for 037ef2c

Commits on Jun 3, 2020

• Make storage_options a dict rather than swallowing kwargs

  

  Martin Durant

  committed
  c3c3075

  Copy full SHA for c3c3075

Commits on Jun 5, 2020

• More requested changes

  

  Martin Durant

  committed
  85d6452

  Copy full SHA for 85d6452

Commits on Jun 10, 2020

• Remove fsspec from locale tests

  Show description for 263dd3b
  

  Martin Durant

  committed
  263dd3b

  Copy full SHA for 263dd3b

• tweak

  

  Martin Durant

  committed
  d0afbc3

  Copy full SHA for d0afbc3

• Merge branch 'master' into feature/add-fsspec-support

  

  Martin Durant

  committed
  6a587a5

  Copy full SHA for 6a587a5

Commits on Jun 11, 2020

• Merge branch 'master' into feature/add-fsspec-support

  

  Martin Durant

  committed
  b2992c1

  Copy full SHA for b2992c1

• requested changes

  

  Martin Durant

  committed
  9c03745

  Copy full SHA for 9c03745

Commits on Jun 12, 2020

• add gcsfs to environment.yml

  

  Martin Durant

  committed
  7982e7b

  Copy full SHA for 7982e7b

• rerun deps script

  

  Martin Durant

  committed
  946297b

  Copy full SHA for 946297b

• Merge branch 'master' into feature/add-fsspec-support

  

  Martin Durant

  committed
  145306e

  Copy full SHA for 145306e

• account for passed filesystem again

  

  Martin Durant

  committed
  06e5a3a

  Copy full SHA for 06e5a3a

• specify should_close

  

  Martin Durant

  committed
  8f3854c

  Copy full SHA for 8f3854c

• lint

  

  Martin Durant

  committed
  50c08c8

  Copy full SHA for 50c08c8

• Except http passed to fsspec in parquet

  Show description for 9b20dc6
  

  Martin Durant

  committed
  9b20dc6

  Copy full SHA for 9b20dc6

• lint

  

  Martin Durant

  committed
  eb90fe8

  Copy full SHA for eb90fe8

Commits on Jun 16, 2020

• Merge branch 'master' into feature/add-fsspec-support

  

  Martin Durant

  committed
  b3e2cd2

  Copy full SHA for b3e2cd2

• redo whatsnew

  

  Martin Durant

  committed
  4977a00

  Copy full SHA for 4977a00

Commits on Jun 18, 2020

• simplify parquet write

  

  Martin Durant

  committed
  29a9785

  Copy full SHA for 29a9785

• Retry S3 file probe with timeout, in test_to_s3

  

  Martin Durant

  committed
  565031b

  Copy full SHA for 565031b

Commits on Jun 19, 2020

• expand user in non-fsspec paths for parquet; add test for this

  

  Martin Durant

  committed
  606ce11

  Copy full SHA for 606ce11

• reorder imports!

  

  Martin Durant

  committed
  60b80a6

  Copy full SHA for 60b80a6