M
mlc-llm
mlc-ai/mlc-llm
Universal LLM Deployment Engine with ML Compilation
★23.0kstars
Python
Apache-2.0
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?A language-model/llm tool in the Data & Infrastructure category, built with Python, open-source
Who made it?Maintained by mlc-ai team, 23K⭐ on GitHub, #77 out of 3133 in Data & Infrastructure
Why does it exist?With the growing demand for language-model and llm in Data & Infrastructure, mlc-ai created mlc-llm as a streamlined solution.
What can it do?Key use cases: machine-learning-compilation, tvm
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/mlc-ai/mlc-llm | 官网 https://llm.mlc.ai/
🔗 github.com/mlc-ai/mlc-llm | 官网 https://llm.mlc.ai/
Topics
language-modelllmmachine-learning-compilationtvm