whereismyai › BigMoeOnEdge
BigMoeOnEdge alternatives
The 12 products closest to BigMoeOnEdge in what they do and who they're for, best match first.
- Edge0 — Stream expert weights from storage on demand to bound peak memory usage. (Code, Free)
- Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
- Mesh LLM — Run large local models across multiple machines through one OpenAI-compatible endpoint. (Code, Free)
- MNN — It delivers high-performance inference and training with a lightweight footprint. (Code, Free)
- MTPLX — It runs local models twice as fast via native MTP speculative decoding. (Code, Free)
- ModLens — Converts screenshots and charts into structured JSON data for coding agents. (Code, Free)
- GoRoute — Consumes 5.1MB of RAM with sub-10ms latency for coding agents. (Code, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- Soup — Fine-tune and align models like Llama-3.1-8B on a 4 GB laptop GPU. (Code, Free)
- FreeToken — Runs 290B+ MoE models on consumer gaming PCs using elastic edge resources. (Code, Free)