AirLLM alternatives

The 12 products closest to AirLLM in what they do and who they're for, best match first.

vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
Soup — Fine-tune and align models like Llama-3.1-8B on a 4 GB laptop GPU. (Code, Free)
LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
fal — Access 1,000+ generative models and high-performance serverless GPUs. (Code, Paid)
WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)
whichllm — Ranks models using real benchmarks and hardware fit instead of parameter count. (Code, Free)
MLX LM — Runs LLMs and fine-tuning natively on Apple silicon hardware. (Code, Free)
llmrun — Check which open models run on your specific GPU or Mac instantly. (Code, Free)
Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
RunThisLLM — Provides exact hardware and VRAM requirements for over 295 local AI models. (Code, Free)