Kyojin alternatives

The 12 products closest to Kyojin in what they do and who they're for, best match first.

oMLX — It uses paged SSD KV caching to reduce agent TTFT to under 5 seconds. (Code, Free)
Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
Infernix — Serves massive Qwen models quickly on a single consumer GPU with advanced caching. (Code, Free)
vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
Resin — Builds high-performance inference engines for complex models like DeepSeek and GLM. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
FreeToken — Runs 290B+ MoE models on consumer gaming PCs using elastic edge resources. (Code, Free)
Shimmy — Runs local AI models with zero Python or C++ dependencies. (Code, Free)
Xinference — Supports a wide range of model types and hardware, including multi-node setups. (Code, Free)
Lumabri — Runs large AI models across multiple computers by sharing memory and layer workloads. (Code, Free)