Shimmy alternatives

The 12 products closest to Shimmy in what they do and who they're for, best match first.

Reflex — It is optimized for cold-start latency and single-tenant decisions. (Code, Free)
Foundry Local — Runs AI models locally on device with complete privacy and no Azure subscription. (Code, Free)
jevgrep — Reduces coding agent costs by providing targeted, relevant repository context. (Code, Free)
Resin — Builds high-performance inference engines for complex models like DeepSeek and GLM. (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
fal — Access 1,000+ generative models and high-performance serverless GPUs. (Code, Paid)
Flare Local Inference — Optimizes memory and bandwidth for workstations and compact systems. (Code, Free)
Enki LLM — Runs Llama-3.2 1B in pure Rust at 40 tok/s with live GPU to CPU migration. (Code, Free)
ort — Provides an ergonomic Rust API for running high-performance ONNX models. (Code, Free)
GPUStack — Unifies AI model serving and GPU compute management across heterogeneous hardware. (Code, Free)
Dlgo — Run LLM inference quickly in pure Go without Python or external runtimes. (Code, Free)