A
AutoGPTQ
AutoGPTQ/AutoGPTQ
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
★5.1kstars
Python
MIT
Updated: 2d ago
📋 Project at a Glance
Tap to expand
What's this?A deep-learning/inference tool in the Data & Infrastructure category, built with Python, open-source
Who made it?Maintained by AutoGPTQ team, 5.1K⭐ on GitHub, #359 out of 3133 in Data & Infrastructure
Why does it exist?With the growing demand for deep-learning and inference in Data & Infrastructure, AutoGPTQ created AutoGPTQ as a streamlined solution.
What can it do?Key use cases: large-language-models, llms, nlp
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/AutoGPTQ/AutoGPTQ
🔗 github.com/AutoGPTQ/AutoGPTQ
Topics
deep-learninginferencelarge-language-modelsllmsnlppytorchquantizationtransformertransformers