V
VLMEvalKit
open-compass/VLMEvalKit
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
★4.3kstars
Python
Apache-2.0
Updated: Today
📋 Project at a Glance
Tap to expand
What's this?Security & Governance project leveraging chatgpt and claude, built with Python, open-source
Who made it?Maintained by open-compass team, 4.3K⭐ on GitHub, #57 out of 413 in Security & Governance
Why does it exist?In the Security & Governance space, chatgpt workflows faced efficiency bottlenecks. VLMEvalKit was built by open-compass to address these claude challenges.
What can it do?Key use cases: clip, computer-vision, evaluation
How to install with AI?Use an AI coding assistant (Claude Code, Cursor, Copilot) to automatically set up pip dependencies and virtual env. Follow the README — the AI handles the rest.
🔗 github.com/open-compass/VLMEvalKit | 官网 https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
🔗 github.com/open-compass/VLMEvalKit | 官网 https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Topics
chatgptclaudeclipcomputer-visionevaluationgeminigptgpt-4vgpt4large-language-modelsllavallmmulti-modalopenaiopenai-apipytorchqwenvitvqa