L
litellm
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
★55.8kstars
Python
NOASSERTION
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?Dev Tools project leveraging ai-gateway and anthropic, built with Python, open-source
Who made it?Maintained by BerriAI team, 55.8K⭐ on GitHub, #14 out of 2853 in Dev Tools
Why does it exist?With the growing demand for ai-gateway and anthropic in Dev Tools, BerriAI created litellm as a streamlined solution.
What can it do?Key use cases: Unified API, API Proxy, Multi-Provider
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/BerriAI/litellm | 官网 https://docs.litellm.ai/docs/
🔗 github.com/BerriAI/litellm | 官网 https://docs.litellm.ai/docs/
Topics
ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyrustrust-aivertex-ai
Use Cases
Unified APIAPI ProxyMulti-Provider