Contents

webdataset 1.0.2

0

High performance storage and I/O for deep learning and data processing.

High performance storage and I/O for deep learning and data processing.

Stars: 2995, Watchers: 2995, Forks: 229, Open Issues: 132

The webdataset/webdataset repo was created 6 years ago and the last code push was 1 weeks ago.
The project is very popular with an impressive 2995 github stars!

How to Install webdataset

You can install webdataset using pip

pip install webdataset

or add it to a project with poetry

poetry add webdataset

Package Details

Author
None
License
BSD-3-Clause
Homepage
None
PyPi:
https://pypi.org/project/webdataset/
GitHub Repo:
https://github.com/webdataset/webdataset

Classifiers

No  webdataset  pypi packages just yet.

Errors

A list of common webdataset errors.

Code Examples

Here are some webdataset code examples and snippets.

GitHub Issues

The webdataset package has 132 open issues on GitHub

  • wds.WebDataset v wds.compat.WebDataset
  • Security Issue: Arbitrary Pickle Deserialization via xdecode/Decoder
  • Refactor Status?
  • The parameter repeat in WebDataset.__init__ does not seem to be used

See more issues on GitHub

Related Packages & Articles

torchsde 0.2.6

SDE solvers and stochastic adjoint sensitivity analysis in PyTorch.

gfpgan 1.3.8

GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration

clean-fid 0.1.35

FID calculation in PyTorch with proper image resizing and quantization steps