Edge0 alternatives

The 12 products closest to Edge0 in what they do and who they're for, best match first.

BigMoeOnEdge — Runs Mixture-of-Experts models larger than device RAM by streaming experts from storage. (Code, Free)
FreeToken — Runs 290B+ MoE models on consumer gaming PCs using elastic edge resources. (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
MNN — It delivers high-performance inference and training with a lightweight footprint. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
GoRoute — Consumes 5.1MB of RAM with sub-10ms latency for coding agents. (Code, Free)
DeepEP Ascend — Optimizes MoE training and inference on Huawei Ascend hardware with low overhead. (Code, Free)
fal — Access 1,000+ generative models and high-performance serverless GPUs. (Code, Paid)
Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
Judge0 — Provides secure, sandboxed code execution for over 60 programming languages. (Code, Freemium)
PEFT — Reduces computational requirements and storage needs for large model training. (Code, Free)
Evo — Routes traffic using custom evaluations rather than global benchmarks. (Code, Free)