whereismyai › Rapid-MLX
Rapid-MLX alternatives
The 12 products closest to Rapid-MLX in what they do and who they're for, best match first.
- MTPLX — It runs local models twice as fast via native MTP speculative decoding. (Code, Free)
- oMLX — It uses paged SSD KV caching to reduce agent TTFT to under 5 seconds. (Code, Free)
- MLX LM — Runs LLMs and fine-tuning natively on Apple silicon hardware. (Code, Free)
- Strata Mlx — Runs 125B MoE models on Apple Silicon by streaming experts directly from disk. (Code, Free)
- MLX Audio — It enables fast audio model inference directly on Apple M-series chips. (Audio, Free)
- LiteLLM — One OpenAI-format API for 100+ LLM providers (Code, Free)
- llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
- Laya Mlx — Provides local MLX inference with no PyTorch or cloud API dependency. (Agents, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- MLC LLM — Enables native optimization and deployment of AI models across platforms. (Code, Free)
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- WebLLM — Runs high-performance language models directly inside web browsers. (Code, Free)