Resin alternatives

The 12 products closest to Resin in what they do and who they're for, best match first.

llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
LightLLM — It delivers high-speed inference and serving performance for large language models. (Code, Free)
fal — Access 1,000+ generative models and high-performance serverless GPUs. (Code, Paid)
Reflex — It is optimized for cold-start latency and single-tenant decisions. (Code, Free)
ZML — It enables Python-free inference while abstracting hardware complexities. (Code, Free)
vLLM — Maximizes throughput with PagedAttention and continuous batching. (Code, Free)
Infernix — Serves massive Qwen models quickly on a single consumer GPU with advanced caching. (Code, Free)
Flare Local Inference — Optimizes memory and bandwidth for workstations and compact systems. (Code, Free)
Shimmy — Runs local AI models with zero Python or C++ dependencies. (Code, Free)
OpenLLM — It simplifies infrastructure management and optimizes inference speed and cost. (Code, Free)