whereismyai › Backburner
Backburner alternatives
The 12 products closest to Backburner in what they do and who they're for, best match first.
- AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
- oMLX — It uses paged SSD KV caching to reduce agent TTFT to under 5 seconds. (Code, Free)
- LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
- llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
- MTPLX — It runs local models twice as fast via native MTP speculative decoding. (Code, Free)
- Lithos Metal — It delivers low-latency LLM inference and local serving on Apple silicon. (Code, Free)
- Distributed Llama — Splits model memory and computation across multiple connected home devices. (Code, Free)
- Soup — Fine-tune and align models like Llama-3.1-8B on a 4 GB laptop GPU. (Code, Free)
- Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
- Kapitsa — Optimized inference engine delivering high token generation speeds on Apple Silicon. (Code, Free)
- MLX LM — Runs LLMs and fine-tuning natively on Apple silicon hardware. (Code, Free)
- Pulsar — It is the fastest inference engine for Qwen models on Apple Silicon. (Code, Free)