L
LightLLM
ModelTC/LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
★4.2kstars
Python
Apache-2.0
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?A , built with Python open-source project in the Data & Infrastructure category, core strengths: deep-learning/gpt
Who made it?Maintained by ModelTC team, 4.2K⭐ on GitHub, #445 out of 3133 in Data & Infrastructure
Why does it exist?The ModelTC team recognized that existing deep-learning tools in Data & Infrastructure were hard to use. LightLLM was designed to make gpt more accessible.
What can it do?Key use cases: llama, llm, model-serving
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/ModelTC/LightLLM
🔗 github.com/ModelTC/LightLLM
Topics
deep-learninggptllamallmmodel-servingnlpopenai-triton