A
aici
microsoft/aici
AICI: Prompts as (Wasm) Programs
★2.1kstars
Rust
MIT
Updated: 1d ago
📋 Project at a Glance
Tap to expand
What's this?A inference/language-model tool in the Data & Infrastructure category, built with Rust, open-source
Who made it?Maintained by microsoft team, 2.1K⭐ on GitHub, #730 out of 3133 in Data & Infrastructure
Why does it exist?In the Data & Infrastructure space, inference workflows faced efficiency bottlenecks. aici was built by microsoft to address these language-model challenges.
What can it do?Key use cases: llm, llm-framework, llm-inference
How to install with AI?Use an AI coding assistant to run cargo build and handle the compilation setup from the README.
🔗 github.com/microsoft/aici
🔗 github.com/microsoft/aici
Topics
aiinferencelanguage-modelllmllm-frameworkllm-inferencellm-servingllmopsmodel-servingrusttransformerwasmwasmtime