smart-open 7.0.5

Utils for streaming large files (S3, HDFS, GCS, Azure Blob Storage, gzip, bz2…)

Stars: 3189, Watchers: 3189, Forks: 385, Open Issues: 75

The piskvorky/smart_open repo was created 9 years ago and the last code push was 1 weeks ago.
The project is very popular with an impressive 3189 github stars!

How to Install smart-open

You can install smart-open using pip

pip install smart-open

or add it to a project with poetry

poetry add smart-open

Package Details

Author

Radim Rehurek

License

MIT

Homepage

https://github.com/piskvorky/smart_open

PyPi:

https://pypi.org/project/smart-open/

GitHub Repo:

https://github.com/piskvorky/smart_open

Classifiers

• Database/Front-Ends
• System/Distributed Computing

Related Packages

Errors

A list of common smart-open errors.

Code Examples

Here are some smart-open code examples and snippets.

GitHub Issues

The smart-open package has 75 open issues on GitHub

• Uploads are unintentionally closed by the del destructor
• S3 Multipart uploads comitted on exception when using compression via context manager
• WIP: Support Alicloud OSS
• Using botocore_session parameter of s3.iter_bucket fails
• Reading a 0 B file from s3 raises KeyError

See more issues on GitHub