V
vllm-ascend
vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Ascend
★2.6kstars
C++
Apache-2.0
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?A , built with C++ open-source project in the Data & Infrastructure category, core strengths: ascend/inference
Who made it?Maintained by vllm-project team, 2.6K⭐ on GitHub, #641 out of 3133 in Data & Infrastructure
Why does it exist?With the growing demand for ascend and inference in Data & Infrastructure, vllm-project created vllm-ascend as a streamlined solution.
What can it do?Key use cases: llm, llm-serving, llmops
How to install with AI?Use an AI coding assistant to follow the README and automatically handle the install and environment setup.
🔗 github.com/vllm-project/vllm-ascend | 官网 https://docs.vllm.ai/projects/ascend
🔗 github.com/vllm-project/vllm-ascend | 官网 https://docs.vllm.ai/projects/ascend
Topics
ascendinferencellmllm-servingllmopsmlopsmodel-servingtransformervllm