LLM CLI alternatives

The 12 products closest to LLM CLI in what they do and who they're for, best match first.

llmspy.org — Self-host access to 530+ AI models across 24 providers with built-in tools. (Chat, Free)
LLM Workflow Engine — Manage and execute complex LLM workflows directly from the command line. (Code, Free)
LiteLLM — One OpenAI-format API for 100+ LLM providers (Code, Free)
LangChain4j — Integrates LLMs and vector stores directly into Java applications. (Code, Free)
WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)
LM Studio — Runs open source language models locally with real-time voice transcription. (Chat, Free)
MLX LM — Runs LLMs and fine-tuning natively on Apple silicon hardware. (Code, Free)
LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
MLC LLM — Enables native optimization and deployment of AI models across platforms. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
LMQL — It enables modularized, constraint-based prompting with portable code. (Code, Free)
llmware — Build private, local RAG pipelines with 300+ prepackaged models and integrated document parsing. (Code, Free)