K
ktransformers
kvcache-ai/ktransformers
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
★19.2kstars
Python
Apache-2.0
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?Data & Infrastructure project leveraging tools-infra and tools-infra, built with Python, open-source
Who made it?Maintained by kvcache-ai team, 19.2K⭐ on GitHub, #91 out of 3133 in Data & Infrastructure
Why does it exist?As the Data & Infrastructure landscape evolved, the kvcache-ai team identified the need for better tools-infra solutions. ktransformers was created to simplify tools-infra workflows.
What can it do?Key use cases: tools-infra
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/kvcache-ai/ktransformers | 官网 https://kvcache-ai.github.io/ktransformers/
🔗 github.com/kvcache-ai/ktransformers | 官网 https://kvcache-ai.github.io/ktransformers/