scalene 2.1.4

Open3D: A Modern Library for 3D Data Processing.

FLOPs calculator with tf.profiler for neural network architecture written in tensorflow 2.2+ (tf.keras)

H2O, Fast Scalable Machine Learning, for python

An utility to monitor NVIDIA GPU status and usage

fastai simplifies training fast and accurate neural nets using modern best practices

DeepSpeed is a Python package developed by Microsoft that provides a deep learning optimization library designed to scale across multiple GPUs and servers. It is capable of training models with billions or even trillions of parameters, achieving excellent system throughput and efficiently scaling to thousands of GPUs.

DeepSpeed is particularly useful for training and inference of large language models, and it falls under the category of Machine Learning Frameworks and Libraries. It is designed to work with PyTorch and offers system innovations such as Zero Redundancy Optimizer (ZeRO), 3D parallelism, and model-parallelism to enable efficient training of large models.

Datadog APM client library

CuPy: NumPy & SciPy for GPU

ClearML Agent - Auto-Magical DevOps for Deep Learning