L
llama.cpp
✨ FeaturedC/C++ implementation of LLM inference. Runs on CPU, GPU, and edge devices. Supports GGUF quantized models.
★78.0kstars
C
MIT
Updated:
Topics
llminferencecppquantization
Use Cases
Inference EngineQuantizationEdge
C/C++ implementation of LLM inference. Runs on CPU, GPU, and edge devices. Supports GGUF quantized models.