D
dynamo
ai-dynamo/dynamo
A Datacenter Scale Distributed Inference Serving Framework
★7.7kstars
Rust
NOASSERTION
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?A diffusion/disaggregated-serving tool in the Data & Infrastructure category, built with Rust, open-source
Who made it?Maintained by ai-dynamo team, 7.7K⭐ on GitHub, #252 out of 3133 in Data & Infrastructure
Why does it exist?The ai-dynamo team recognized that existing diffusion tools in Data & Infrastructure were hard to use. dynamo was designed to make disaggregated-serving more accessible.
What can it do?Key use cases: kubernetes, llm-inference, omni
How to install with AI?Use an AI coding assistant to run cargo build and handle the compilation setup from the README.
🔗 github.com/ai-dynamo/dynamo | 官网 https://docs.nvidia.com/dynamo/latest
🔗 github.com/ai-dynamo/dynamo | 官网 https://docs.nvidia.com/dynamo/latest
Topics
diffusiondisaggregated-servingkubernetesllm-inferenceomnirouting-enginerustsglangtensorrt-llmvllm