whereismyai › LMMs-Eval
LMMs-Eval alternatives
The 12 products closest to LMMs-Eval in what they do and who they're for, best match first.
- VLMEvalKit — Evaluate large vision-language models across numerous benchmarks with a single command. (Research, Free)
- EvalScope — It combines model capability benchmarks with inference performance testing in one tool. (Research, Free)
- Lighteval — Evaluates LLMs across multiple backends with thousands of built-in tasks. (Research, Free)
- OpenCompass — It offers an objective, comprehensive, and credible open-source AI evaluation system. (Research, Free)
- OpenVLHarness — Lifts six multimodal model backbones by 9.7 to 12.6 points across 22 benchmarks. (Research, Free)
- MTEB — Evaluates embedding models across over 1000 tasks and 1000 languages. (Research, Free)
- Vlmhub — Run multimodal prompts across multiple local and cloud backends without rewriting inference code. (Code, Free)
- Evals Skills — It helps avoid common mistakes and pitfalls when building AI evaluation suites. (Code, Free)
- Vegaml — Runs locally on your hardware with calibrated probabilities and conformal answer sets. (Research, Free)
- LLM Wiki Research — Compiles parallel agent research into source-backed markdown knowledge bases. (Research, Free)
- Rsi Eval — It supplies the evaluation boundary so methods can use existing benchmarks without reimplementing execution. (Research, Free)
- Homi — It answers complex audio questions natively with high accuracy. (Research, Free)