B
bitsandbytes
bitsandbytes-foundation/bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
★8.4kstars
Python
MIT
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?A open-source Data & Infrastructure project, built with Python, focusing on llm and machine-learning
Who made it?Maintained by bitsandbytes-foundation team, 8.4K⭐ on GitHub, #238 out of 3133 in Data & Infrastructure
Why does it exist?The bitsandbytes-foundation team recognized that existing llm tools in Data & Infrastructure were hard to use. bitsandbytes was designed to make machine-learning more accessible.
What can it do?Key use cases: pytorch, qlora, quantization
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/bitsandbytes-foundation/bitsandbytes | 官网 https://huggingface.co/docs/bitsandbytes/main/en/index
🔗 github.com/bitsandbytes-foundation/bitsandbytes | 官网 https://huggingface.co/docs/bitsandbytes/main/en/index
Topics
llmmachine-learningpytorchqloraquantization