LazyLLM alternatives

The 12 products closest to LazyLLM in what they do and who they're for, best match first.

LLM CLI — It enables command-line interaction with remote APIs and local machine models. (Code, Free)
rLLM — Enables reinforcement learning training for AI agents with minimal code changes. (Code, Free)
LazyCodex — It runs outcome-first, evidence-driven orchestration to verify code changes. (Code, Free)
WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
OpenLLM — It simplifies infrastructure management and optimizes inference speed and cost. (Code, Free)
LiteLLM — One OpenAI-format API for 100+ LLM providers (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
Langroid — Simplifies multi-agent orchestration and app development with intuitive abstractions. (Code, Free)