whereismyai › DeepEP Ascend
DeepEP Ascend alternatives
The 12 products closest to DeepEP Ascend in what they do and who they're for, best match first.
- vLLM Ascend — It enables vLLM functionality on Huawei Ascend NPU hardware. (Code, Free)
- llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
- Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- MNN — It delivers high-performance inference and training with a lightweight footprint. (Code, Free)
- Edge0 — Stream expert weights from storage on demand to bound peak memory usage. (Code, Free)
- fal — Access 1,000+ generative models and high-performance serverless GPUs. (Code, Paid)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- ncnn — No runtime dependencies and supports CPU and Vulkan GPU backends. (Code, Free)
- Strata Mlx — Runs 125B MoE models on Apple Silicon by streaming experts directly from disk. (Code, Free)
- Kyojin — Runs 100 GB-class models in 128 GB with speculative decoding. (Code, Free)
- Resin — Builds high-performance inference engines for complex models like DeepSeek and GLM. (Code, Free)