Skip to content

(WIP) fsspec compat#116

Closed
martindurant wants to merge 6 commits into
fsspec:masterfrom
martindurant:fsspec_compat
Closed

(WIP) fsspec compat#116
martindurant wants to merge 6 commits into
fsspec:masterfrom
martindurant:fsspec_compat

Conversation

@martindurant
Copy link
Copy Markdown
Member

@martindurant martindurant commented Oct 29, 2018

Start of compatibility with fsspec.

Note the large amount of removed code.

In [2]: from fsspec.core import open_files
In [3]: open_files('gcs://mdtemp/*.avro', storage_options={'token': 'anon'})
[<OpenFile 'mdtemp/one.avro'>, <OpenFile 'mdtemp/two.avro'>]

@martindurant
Copy link
Copy Markdown
Member Author

martindurant commented Oct 29, 2018

(will fail tests, not updated at all)

@martindurant martindurant changed the title Fsspec compat (WIP) fsspec compat Oct 29, 2018
@martindurant martindurant mentioned this pull request Nov 6, 2018
Open
Martin Durant added 2 commits November 6, 2018 18:25
@martindurant martindurant mentioned this pull request Nov 7, 2018
Open
Martin Durant added 2 commits November 22, 2018 21:01
Merge branch 'master' into fsspec_compat
b5947b2 
Base GCSFile on AbstractBuffered File

Missing: no route to _simple_upload, calls _initiate_upload always
Many tests working [skip ci]
ab50675
@martindurant martindurant mentioned this pull request Nov 26, 2018
Closed
@martindurant martindurant mentioned this pull request Dec 28, 2018
Closed
7 tasks
@martindurant
Copy link
Copy Markdown
Member Author

martindurant commented Jun 28, 2019

Will make new PR with recent changes included to supersede this one.

@martindurant martindurant deleted the fsspec_compat branch June 28, 2019 23:40
@ahmedx2 ahmedx2 mentioned this pull request Aug 27, 2019
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@martindurant