oMLX alternatives

The 12 products closest to oMLX in what they do and who they're for, best match first.

MTPLX — It runs local models twice as fast via native MTP speculative decoding. (Code, Free)
Rapid-MLX — Run 250 MLX-native models locally on Apple Silicon with high inference speeds. (Code, Free)
OpenCode — Works with 75+ model providers, local models, and existing subscriptions (Code, Free)
OmniRoute — Routes requests across 352 providers with automatic fallback and cost-based selection. (Code, Free)
OpenMonoAgent — Runs locally on your own hardware with no recurring subscription fees. (Code, Free)
MLX LM — Runs LLMs and fine-tuning natively on Apple silicon hardware. (Code, Free)
ODS — Automates complex local AI infrastructure setups with one command. (Code, Free)
Mesh LLM — Run large local models across multiple machines through one OpenAI-compatible endpoint. (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
Pulsar — It is the fastest inference engine for Qwen models on Apple Silicon. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)