fsspec 2024.3.1

File-system specification

Stars: 908, Watchers: 908, Forks: 329, Open Issues: 254

The fsspec/filesystem_spec repo was created 6 years ago and the last code push was Yesterday.
The project is popular with 908 github stars!

How to Install fsspec

You can install fsspec using pip

pip install fsspec

or add it to a project with poetry

poetry add fsspec

Package Details

Author

License

BSD

Homepage

https://github.com/fsspec/filesystem_spec

PyPi:

https://pypi.org/project/fsspec/

Documentation:

https://filesystem-spec.readthedocs.io/en/latest/

GitHub Repo:

https://github.com/intake/filesystem_spec

Classifiers

Related Packages

Errors

A list of common fsspec errors.

Code Examples

Here are some fsspec code examples and snippets.

GitHub Issues

The fsspec package has 254 open issues on GitHub

• Add optional file-based listings caching
• Deadlock involving pandas.read_excel and AWS S3
• Add gist FS
• [FEA] Add precaching support within file-opening functions
• Change sftp rename from posix_rename() to rename()
• put() inconsistent with cp
• Rename the first argument to ReferenceFileSystem
• Make url in get_mapper optional
• fsspec.implementations.hdfs.PyArrowHDFS → fsspec.implementations.arrow.HadoopFileSystem
• FileNotFoundError is raised when failing to access a http url
• Allow ReferenceFS to refer to multiple FSs
• spec: add sync/async connect/disconnect
• Publicly expose/document API for retrieving cache file details
• local caching with custom endpoint
• fuse: 'memory' is (mis)interpreted as 'file://', not 'memory://'

See more issues on GitHub