Enki LLM alternatives

The 12 products closest to Enki LLM in what they do and who they're for, best match first.

AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
LLamaSharp — Runs large language models efficiently on local hardware using C#. (Code, Free)
Resin — Builds high-performance inference engines for complex models like DeepSeek and GLM. (Code, Free)
llama-swap — It runs multiple local AI models with zero external dependencies. (Code, Free)
WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
Shimmy — Runs local AI models with zero Python or C++ dependencies. (Code, Free)
ort — Provides an ergonomic Rust API for running high-performance ONNX models. (Code, Free)
whichllm — Ranks models using real benchmarks and hardware fit instead of parameter count. (Code, Free)
Distributed Llama — Splits model memory and computation across multiple connected home devices. (Code, Free)