SGLang alternatives

The 12 products closest to SGLang in what they do and who they're for, best match first.

AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
Dlgo — Run LLM inference quickly in pure Go without Python or external runtimes. (Code, Free)
LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
fal — Access 1,000+ generative models and high-performance serverless GPUs. (Code, Paid)
XTuner — High-efficiency training for 200B+ scale MoE models without expert parallelism. (Code, Free)
GPUStack — Unifies AI model serving and GPU compute management across heterogeneous hardware. (Code, Free)
Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
Resin — Builds high-performance inference engines for complex models like DeepSeek and GLM. (Code, Free)
Ray — It orchestrates distributed infrastructure for any AI workload at any scale. (Code, Free)