MTEB alternatives

The 12 products closest to MTEB in what they do and who they're for, best match first.

VLMEvalKit — Evaluate large vision-language models across numerous benchmarks with a single command. (Research, Free)
FastEmbed — It uses ONNX Runtime for high speed and does not require a GPU or PyTorch. (Code, Free)
WeMM Embedding — Provides state-of-the-art performance across multiple multimodal benchmarks. (Research, Free)
LMMs-Eval — Provides open research and tooling for multimodal model evaluation and benchmarks. (Research, Free)
Lighteval — Evaluates LLMs across multiple backends with thousands of built-in tasks. (Research, Free)
LiveBench — Compare model performance and operational costs without contamination. (Research, Free)
Overview — Learn language models by running hands-on experiments without writing scripts (Research, Free)
BGE Embeddings — Provides specialized models for high-performance information retrieval. (Search, Free)
Text Embeddings Inference — High-performance serving for open-source embedding models. (Code, Free)
OpenVLHarness — Lifts six multimodal model backbones by 9.7 to 12.6 points across 22 benchmarks. (Research, Free)
Benchpress — Evaluates document artificial intelligence models against specific user pages for accuracy, cost, and speed. (Research, Free)
Finetuning With Sampling — Official implementation of the Finetuning with Sampling research paper from Harvard. (Research, Free)