GPUStack alternatives

The 12 products closest to GPUStack in what they do and who they're for, best match first.

Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
iwant — Spins up cloud GPUs and open models instantly via a single command. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
Narwhal — It automatically hot-swaps prefill and decode roles without reloading model weights. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
Rigmark — Measures local AI performance with reproducible, agent-like workloads. (Code, Free)
Together AI — Fast serverless inference and GPU clusters with transparent token pricing. (Code, Paid)
RunThisLLM — Provides exact hardware and VRAM requirements for over 295 local AI models. (Code, Free)
fal — Access 1,000+ generative models and high-performance serverless GPUs. (Code, Paid)
llmrun — Check which open models run on your specific GPU or Mac instantly. (Code, Free)
Imp — Runs local models directly on NVIDIA Blackwell hardware using native 4-bit math. (Code, Free)