LiteLLM alternatives

The 12 products closest to LiteLLM in what they do and who they're for, best match first.

OptiLLM — Increases LLM reasoning accuracy by up to 10x without model training. (Code, Free)
WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)
LitGPT — Readable single-file LLM code with tested finetuning recipes (Code, Free)
LLM CLI — It enables command-line interaction with remote APIs and local machine models. (Code, Free)
MLC LLM — Enables native optimization and deployment of AI models across platforms. (Code, Free)
Mesh LLM — Run large local models across multiple machines through one OpenAI-compatible endpoint. (Code, Free)
OpenLIT — It enables comprehensive monitoring, evaluation, and management of AI agents via OpenTelemetry. (Code, Free)
OpenLLM — It simplifies infrastructure management and optimizes inference speed and cost. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
StrictLLM — It keeps your AI workflows secure and reviewable with sandboxed MCP servers and strict tool permissions. (Chat, Freemium)