L
lmms-eval
EvolvingLMMs-Lab/lmms-eval
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
★4.4kstars
Python
NOASSERTION
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?Security & Governance project leveraging agi and audio-evaluation, built with Python, open-source
Who made it?Maintained by EvolvingLMMs-Lab team, 4.4K⭐ on GitHub, #56 out of 413 in Security & Governance
Why does it exist?In the Security & Governance space, agi workflows faced efficiency bottlenecks. lmms-eval was built by EvolvingLMMs-Lab to address these audio-evaluation challenges.
What can it do?Key use cases: benchmark, evaluation, large-language-models
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/EvolvingLMMs-Lab/lmms-eval | 官网 https://www.lmms-lab.com
🔗 github.com/EvolvingLMMs-Lab/lmms-eval | 官网 https://www.lmms-lab.com
Topics
agiaudio-evaluationbenchmarkevaluationlarge-language-modelsllm-evaluationmultimodalmultimodal-evaluationvideo-understandingvision-language-modelvlm