T
text-generation-inference
huggingface/text-generation-inference
Large Language Model Text Generation Inference
★10.9kstars
Python
Apache-2.0
Updated: 2d ago
📋 Project at a Glance
Tap to expand
What's this?A bloom/deep-learning tool in the Data & Infrastructure category, built with Python, open-source
Who made it?Maintained by huggingface team, 10.9K⭐ on GitHub, #176 out of 3133 in Data & Infrastructure
Why does it exist?With the growing demand for bloom and deep-learning in Data & Infrastructure, huggingface created text-generation-inference as a streamlined solution.
What can it do?Key use cases: falcon, gpt, inference
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/huggingface/text-generation-inference | 官网 http://hf.co/docs/text-generation-inference
🔗 github.com/huggingface/text-generation-inference | 官网 http://hf.co/docs/text-generation-inference
Topics
bloomdeep-learningfalcongptinferencenlppytorchstarcodertransformer