deltalake 0.16.4

Native Delta Lake Python binding based on delta-rs with Pandas integration

Stars: 1794, Watchers: 1794, Forks: 343, Open Issues: 244

The delta-io/delta-rs repo was created 3 years ago and the last code push was 6 hours ago.
The project is very popular with an impressive 1794 github stars!

How to Install deltalake

You can install deltalake using pip

pip install deltalake

or add it to a project with poetry

poetry add deltalake

Package Details

Author

Qingping Hou <[email protected]>, Will Jones <[email protected]>

License

Apache-2.0

Homepage

https://github.com/delta-io/delta-rs

PyPi:

https://pypi.org/project/deltalake/

GitHub Repo:

https://github.com/delta-io/delta-rs

Classifiers

Related Packages

Errors

A list of common deltalake errors.

Code Examples

Here are some deltalake code examples and snippets.

GitHub Issues

The deltalake package has 244 open issues on GitHub

• Fix VACUUM by using the URI of the DeltaTable when filtering the files to delete
• Implement polling for table updates. (#413)
• VACUUM operation failed with a S3 path
• ADLS Gen2 backend should check if the storage account has hierarchical namespaces enabled
• [Azure] Remove references to abfs
• Python PyArrow Dataset Writer
• WIP: formally verify S3 atomic rename
• Add golden files and create tests #179
• R bindings
• Update README.md
• Support file index
• Programmatic authentication for Azure
• [WIP] Towards high level writer
• Implement missing Azure storage backend methods
• [Discussion] Improve Azure e2e/integration testing

See more issues on GitHub