whereismyai › vLLM Semantic Router
vLLM Semantic Router alternatives
The 12 products closest to vLLM Semantic Router in what they do and who they're for, best match first.
- llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
- FreeLLMAPI — Accesses hundreds of free LLM models and billions of tokens through one API key. (Code, Free)
- LiteLLM — One OpenAI-format API for 100+ LLM providers (Code, Free)
- LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
- Mesh LLM — Run large local models across multiple machines through one OpenAI-compatible endpoint. (Code, Free)
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- GoRoute — Consumes 5.1MB of RAM with sub-10ms latency for coding agents. (Code, Free)
- WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)
- OpenLLM — It simplifies infrastructure management and optimizes inference speed and cost. (Code, Free)
- llmware — Build private, local RAG pipelines with 300+ prepackaged models and integrated document parsing. (Code, Free)
- Evo — Routes traffic using custom evaluations rather than global benchmarks. (Code, Free)