W
web-llm
mlc-ai/web-llm
High-performance In-browser LLM Inference Engine
★18.5kstars
TypeScript
Apache-2.0
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?A open-source Data & Infrastructure project, built with TypeScript, focusing on chatgpt and deep-learning
Who made it?Maintained by mlc-ai team, 18.5K⭐ on GitHub, #96 out of 3133 in Data & Infrastructure
Why does it exist?The mlc-ai team recognized that existing chatgpt tools in Data & Infrastructure were hard to use. web-llm was designed to make deep-learning more accessible.
What can it do?Key use cases: language-model, llm, tvm
How to install with AI?Use an AI coding assistant to automatically run npm/pnpm install and configure the project per the README.
🔗 github.com/mlc-ai/web-llm | 官网 https://webllm.mlc.ai
🔗 github.com/mlc-ai/web-llm | 官网 https://webllm.mlc.ai
Topics
chatgptdeep-learninglanguage-modelllmtvmwebgpuwebml