N
nano-vllm
GeeeekExplorer/nano-vllm
Nano vLLM
★14.9kstars
Python
MIT
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?A open-source Data & Infrastructure project, built with Python, focusing on deep-learning and inference
Who made it?Maintained by GeeeekExplorer team, 14.9K⭐ on GitHub, #123 out of 3133 in Data & Infrastructure
Why does it exist?The GeeeekExplorer team recognized that existing deep-learning tools in Data & Infrastructure were hard to use. nano-vllm was designed to make inference more accessible.
What can it do?Key use cases: llm, nlp, pytorch
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/GeeeekExplorer/nano-vllm
🔗 github.com/GeeeekExplorer/nano-vllm
Topics
deep-learninginferencellmnlppytorchtransformer