whereismyai › DeepSpeed
DeepSpeed alternatives
The 12 products closest to DeepSpeed in what they do and who they're for, best match first.
- TokenSpeed — Optimized performance for agentic workloads and high-throughput LLM serving. (Code, Free)
- DeepEP Ascend — Optimizes MoE training and inference on Huawei Ascend hardware with low overhead. (Code, Free)
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- XTuner — High-efficiency training for 200B+ scale MoE models without expert parallelism. (Code, Free)
- Dsv41 Flash Offload — Runs a large DeepSeek model locally using consumer hardware and offloaded host RAM. (Code, Free)
- SGLang — It delivers high-throughput, low-latency serving for large-scale deployments. (Code, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- CoralBricks — Fast inference up to 469 output tokens per second with zero cost for cached input. (Code, Freemium)
- NVIDIA Model Optimizer — Compress deep learning models to accelerate inference performance. (Code, Free)
- PEFT — Reduces computational requirements and storage needs for large model training. (Code, Free)
- Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
- llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)