Taco alternatives

The 12 products closest to Taco in what they do and who they're for, best match first.

AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
Vramkit — It cuts GPU memory usage using verified benchmarks on real models. (Code, Free)
fal — Access 1,000+ generative models and high-performance serverless GPUs. (Code, Paid)
whichllm — Ranks models using real benchmarks and hardware fit instead of parameter count. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
Soup — Fine-tune and align models like Llama-3.1-8B on a 4 GB laptop GPU. (Code, Free)
Enki LLM — Runs Llama-3.2 1B in pure Rust at 40 tok/s with live GPU to CPU migration. (Code, Free)
Neural Compressor — Supports advanced quantization and sparsity for large language models. (Code, Free)
MTPLX — It runs local models twice as fast via native MTP speculative decoding. (Code, Free)
GPTCache — It decreases expenses and enhances performance by caching LLM query results. (Code, Free)