
auto-gptq 0.7.1
0
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Contents
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Stars: 5026, Watchers: 5026, Forks: 531, Open Issues: 274The AutoGPTQ/AutoGPTQ repo was created 2 years ago and the last code push was 10 months ago.
The project is extremely popular with a mindblowing 5026 github stars!
How to Install auto-gptq
You can install auto-gptq using pip
pip install auto-gptq
or add it to a project with poetry
poetry add auto-gptq
Package Details
- Author
- PanQiWei
- License
- Homepage
- https://github.com/PanQiWei/AutoGPTQ
- PyPi:
- https://pypi.org/project/auto-gptq/
- GitHub Repo:
- https://github.com/PanQiWei/AutoGPTQ
Classifiers
Related Packages
Errors
A list of common auto-gptq errors.
Code Examples
Here are some auto-gptq code examples and snippets.
pythonfix







