S
semantic-router
vllm-project/semantic-router
A programmable Mixture-of-Models router for heterogeneous LLM inference
★5.1kstars
Go
Apache-2.0
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?Data & Infrastructure project leveraging ai-gateway and bert-classification, built with Go, open-source
Who made it?Maintained by vllm-project team, 5.1K⭐ on GitHub, #354 out of 3133 in Data & Infrastructure
Why does it exist?With the growing demand for ai-gateway and bert-classification in Data & Infrastructure, vllm-project created semantic-router as a streamlined solution.
What can it do?Key use cases: fine-tuning, golang, huggingface-candle
How to install with AI?Use an AI coding assistant to run go install and handle the build configuration automatically.
🔗 github.com/vllm-project/semantic-router | 官网 https://vllm-sr.ai
🔗 github.com/vllm-project/semantic-router | 官网 https://vllm-sr.ai
Topics
ai-gatewaybert-classificationfine-tuninggolanghuggingface-candlehuggingface-transformerskubernetesllmllmroutermcpmixture-of-modelsopenclawpii-detectionprompt-engineeringprompt-guardrustsemantic-routervllm