whereismyai › VLMEvalKit
VLMEvalKit alternatives
The 12 products closest to VLMEvalKit in what they do and who they're for, best match first.
- Vlmhub — Run multimodal prompts across multiple local and cloud backends without rewriting inference code. (Code, Free)
- Lighteval — Evaluates LLMs across multiple backends with thousands of built-in tasks. (Research, Free)
- LMMs-Eval — Provides open research and tooling for multimodal model evaluation and benchmarks. (Research, Free)
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- EvalScope — It combines model capability benchmarks with inference performance testing in one tool. (Research, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- OpenVLHarness — Lifts six multimodal model backbones by 9.7 to 12.6 points across 22 benchmarks. (Research, Free)
- vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
- DeepEval — Provides over fifty research-backed metrics and pytest-native execution. (Code, Freemium)
- MTEB — Evaluates embedding models across over 1000 tasks and 1000 languages. (Research, Free)
- LMFlow — It offers memory-efficient training and full Accelerate support for large language models. (Code, Free)
- LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)