whereismyai › Lighteval
Lighteval alternatives
The 12 products closest to Lighteval in what they do and who they're for, best match first.
- VLMEvalKit — Evaluate large vision-language models across numerous benchmarks with a single command. (Research, Free)
- DeepEval — Provides over fifty research-backed metrics and pytest-native execution. (Code, Freemium)
- EvalScope — It combines model capability benchmarks with inference performance testing in one tool. (Research, Free)
- LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
- LMMs-Eval — Provides open research and tooling for multimodal model evaluation and benchmarks. (Research, Free)
- OpenVLHarness — Lifts six multimodal model backbones by 9.7 to 12.6 points across 22 benchmarks. (Research, Free)
- vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
- MTEB — Evaluates embedding models across over 1000 tasks and 1000 languages. (Research, Free)
- WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)
- Hugging Face — Home of open-source AI models and the Transformers library (Research, Freemium)
- StreamEval — A specialized benchmark for interactive streaming video generation models. (Research, Free)
- llmware — Build private, local RAG pipelines with 300+ prepackaged models and integrated document parsing. (Code, Free)