Soup alternatives

The 12 products closest to Soup in what they do and who they're for, best match first.

AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
MLX LM — Runs LLMs and fine-tuning natively on Apple silicon hardware. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
MTPLX — It runs local models twice as fast via native MTP speculative decoding. (Code, Free)
whichllm — Ranks models using real benchmarks and hardware fit instead of parameter count. (Code, Free)
Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
LlamaFactory — Provides a code-free CLI and Web UI for training 100+ different LLMs. (Code, Free)
OptiQ — Runs entirely on Apple Silicon without PyTorch or cloud dependence. (Code, Free)
WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)
vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
Dlgo — Run LLM inference quickly in pure Go without Python or external runtimes. (Code, Free)