Sturnus alternatives

The 12 products closest to Sturnus in what they do and who they're for, best match first.

OrcaRouter — Route requests to the best models without paying token markups. (Code, Freemium)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
FreeLLMAPI — Accesses hundreds of free LLM models and billions of tokens through one API key. (Code, Free)
GoRoute — Consumes 5.1MB of RAM with sub-10ms latency for coding agents. (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
OpenLLM — Routes developer tools through multiple providers and local models with included inference. (Code, Free)
LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
Semantic Router — Replaces slow LLM calls with fast deterministic routing. (Code, Free)
OmniRoute — Routes requests across 352 providers with automatic fallback and cost-based selection. (Code, Free)
New Relic — Unified visibility across applications, infrastructure, and AI models. (Code, Freemium)
Weave Router — Routes prompts to cost-efficient models while preserving speed and quality. (Code, Freemium)
Mesh LLM — Run large local models across multiple machines through one OpenAI-compatible endpoint. (Code, Free)