L
llamafile
mozilla-ai/llamafile
Distribute and run LLMs with a single file.
★25.5kstars
C++
NOASSERTION
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?Data & Infrastructure project leveraging cross-platform and gguf, built with C++, open-source
Who made it?Maintained by mozilla-ai team, 25.5K⭐ on GitHub, #68 out of 3133 in Data & Infrastructure
Why does it exist?The mozilla-ai team recognized that existing cross-platform tools in Data & Infrastructure were hard to use. llamafile was designed to make gguf more accessible.
What can it do?Key use cases: llama-cpp, local-ai, local-inference
How to install with AI?Use an AI coding assistant to follow the README and automatically handle the install and environment setup.
🔗 github.com/mozilla-ai/llamafile | 官网 https://docs.mozilla.ai/llamafile
🔗 github.com/mozilla-ai/llamafile | 官网 https://docs.mozilla.ai/llamafile
Topics
cross-platformggufllama-cpplocal-ailocal-inferencelocal-llmopen-source-aisingle-file-executablespeech-to-text