Evalship alternatives

The 11 products closest to Evalship in what they do and who they're for, best match first.

Evals Skills — It helps avoid common mistakes and pitfalls when building AI evaluation suites. (Code, Free)
EvalCart — Test shopping agents with a fixed grocery catalog, tasks, and a deterministic scorer. (Research, Free)
EvalScope — It combines model capability benchmarks with inference performance testing in one tool. (Research, Free)
Rsi Eval — It supplies the evaluation boundary so methods can use existing benchmarks without reimplementing execution. (Research, Free)
LMMs-Eval — Provides open research and tooling for multimodal model evaluation and benchmarks. (Research, Free)
Lighteval — Evaluates LLMs across multiple backends with thousands of built-in tasks. (Research, Free)
LLM Stats — Independent rankings updated continuously from live API metrics. (Research, Free)
LLM Wiki Research — Compiles parallel agent research into source-backed markdown knowledge bases. (Research, Free)
VLMEvalKit — Evaluate large vision-language models across numerous benchmarks with a single command. (Research, Free)
AutoResearch — It provides a stateful, reproducible workflow for automated AI research. (Research, Free)
Vegaml — Runs locally on your hardware with calibrated probabilities and conformal answer sets. (Research, Free)