S
sglang
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
★31.5kstars
Python
Apache-2.0
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?Data & Infrastructure project leveraging attention and blackwell, built with Python, open-source
Who made it?Maintained by sgl-project team, 31.5K⭐ on GitHub, #53 out of 3133 in Data & Infrastructure
Why does it exist?The sgl-project team recognized that existing attention tools in Data & Infrastructure were hard to use. sglang was designed to make blackwell more accessible.
What can it do?Key use cases: cuda, deepseek, diffusion
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/sgl-project/sglang | 官网 https://sglang.io
🔗 github.com/sgl-project/sglang | 官网 https://sglang.io
Topics
attentionblackwellcudadeepseekdiffusionglmgpt-ossinferencellamallmminimaxmoeqwenqwen-imagereinforcement-learningtransformervlmwan