I
ipex-llm
intel/ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
★8.9kstars
Python
Apache-2.0
Updated: 1d ago
📋 Project at a Glance
Tap to expand
What's this?A , built with Python open-source project in the Data & Infrastructure category, core strengths: gpu/llm
Who made it?Maintained by intel team, 8.9K⭐ on GitHub, #228 out of 3133 in Data & Infrastructure
Why does it exist?With the growing demand for gpu and llm in Data & Infrastructure, intel created ipex-llm as a streamlined solution.
What can it do?Key use cases: pytorch, transformers
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/intel/ipex-llm
🔗 github.com/intel/ipex-llm
Topics
gpullmpytorchtransformers