B
BentoML
bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
★8.8kstars
Python
Apache-2.0
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?A ai-inference/deep-learning tool in the Data & Infrastructure category, built with Python, open-source
Who made it?Maintained by bentoml team, 8.8K⭐ on GitHub, #232 out of 3133 in Data & Infrastructure
Why does it exist?With the growing demand for ai-inference and deep-learning in Data & Infrastructure, bentoml created BentoML as a streamlined solution.
What can it do?Key use cases: generative-ai, inference-platform, llm
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/bentoml/BentoML | 官网 https://bentoml.com
🔗 github.com/bentoml/BentoML | 官网 https://bentoml.com
Topics
ai-inferencedeep-learninggenerative-aiinference-platformllmllm-inferencellm-servingllmopsmachine-learningml-engineeringmlopsmodel-inference-servicemodel-servingmultimodalpython