whereismyai › Lithos Metal
Lithos Metal alternatives
The 12 products closest to Lithos Metal in what they do and who they're for, best match first.
- LiteLLM — One OpenAI-format API for 100+ LLM providers (Code, Free)
- MTPLX — It runs local models twice as fast via native MTP speculative decoding. (Code, Free)
- oMLX — It uses paged SSD KV caching to reduce agent TTFT to under 5 seconds. (Code, Free)
- llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
- MLX LM — Runs LLMs and fine-tuning natively on Apple silicon hardware. (Code, Free)
- Rapid-MLX — Run 250 MLX-native models locally on Apple Silicon with high inference speeds. (Code, Free)
- Backburner — Extends LLM context limits and speeds up prompt reading using iPhone hardware. (Code, Free)
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- Mesh LLM — Run large local models across multiple machines through one OpenAI-compatible endpoint. (Code, Free)
- Enki LLM — Runs Llama-3.2 1B in pure Rust at 40 tok/s with live GPU to CPU migration. (Code, Free)
- Kapitsa — Optimized inference engine delivering high token generation speeds on Apple Silicon. (Code, Free)
- Strata Mlx — Runs 125B MoE models on Apple Silicon by streaming experts directly from disk. (Code, Free)