mtscomp 1.0.2

Numpy data serialization using msgpack

LZ4 Bindings for Python

Extra features for Python's JSON: comments, order, numpy, pandas, datetimes, and many more! Simple but customizable.

MXNet Gluon NLP Toolkit

A new flavour of deep learning operations

DeepSpeed is a Python package developed by Microsoft that provides a deep learning optimization library designed to scale across multiple GPUs and servers. It is capable of training models with billions or even trillions of parameters, achieving excellent system throughput and efficiently scaling to thousands of GPUs.

DeepSpeed is particularly useful for training and inference of large language models, and it falls under the category of Machine Learning Frameworks and Libraries. It is designed to work with PyTorch and offers system innovations such as Zero Redundancy Optimizer (ZeRO), 3D parallelism, and model-parallelism to enable efficient training of large models.

HuggingFace community-driven open-source library of datasets

Dataframe comparison in Python

Type stubs for Python machine learning libraries