MLX LM alternatives

The 12 products closest to MLX LM in what they do and who they're for, best match first.

MTPLX — It runs local models twice as fast via native MTP speculative decoding. (Code, Free)
Soup — Fine-tune and align models like Llama-3.1-8B on a 4 GB laptop GPU. (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
Rapid-MLX — Run 250 MLX-native models locally on Apple Silicon with high inference speeds. (Code, Free)
MLC LLM — Enables native optimization and deployment of AI models across platforms. (Code, Free)
oMLX — It uses paged SSD KV caching to reduce agent TTFT to under 5 seconds. (Code, Free)
Mesh LLM — Run large local models across multiple machines through one OpenAI-compatible endpoint. (Code, Free)
LLM CLI — It enables command-line interaction with remote APIs and local machine models. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
LangChain4j — Integrates LLMs and vector stores directly into Java applications. (Code, Free)