shimmy

Llama 3+ inference in pure Java

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/Q

AI inference, packed simply. A blazing-fast, zero-dependency WebGPU runtime to r

ModelFox makes it easy to train, deploy, and monitor machine learning models.