GPTCache alternatives

The 12 products closest to GPTCache in what they do and who they're for, best match first.

LMCache — It stores, compresses, searches, and reuses KV caches across clusters. (Code, Free)
Sulci Oss — Caches responses semantically to skip repeat LLM calls and reduce latency. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
LangChain4j — Integrates LLMs and vector stores directly into Java applications. (Code, Free)
LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
LitGPT — Readable single-file LLM code with tested finetuning recipes (Code, Free)
llmware — Build private, local RAG pipelines with 300+ prepackaged models and integrated document parsing. (Code, Free)
Lcc — Cuts token counts significantly without losing exact session details. (Code, Free)
gptel — Direct LLM interaction inside the Emacs text editor. (Code, Free)
GoRoute — Consumes 5.1MB of RAM with sub-10ms latency for coding agents. (Code, Free)
GPUStack — Unifies AI model serving and GPU compute management across heterogeneous hardware. (Code, Free)