LMCache alternatives

The 12 products closest to LMCache in what they do and who they're for, best match first.

GPTCache — It decreases expenses and enhances performance by caching LLM query results. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
MLC LLM — Enables native optimization and deployment of AI models across platforms. (Code, Free)
MemPalace — Achieves high recall with local-first storage and zero API calls. (Agents, Free)
vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
Sulci Oss — Caches responses semantically to skip repeat LLM calls and reduce latency. (Code, Free)
LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
oMLX — It uses paged SSD KV caching to reduce agent TTFT to under 5 seconds. (Code, Free)
AI Memory — Shared memory for coding agents that works across machines and team members. (Code, Free)
Codebase Memory MCP — High-speed indexing and persistent knowledge graphs for AI coding agents. (Code, Free)
LangChain4j — Integrates LLMs and vector stores directly into Java applications. (Code, Free)