Narwhal alternatives

The 12 products closest to Narwhal in what they do and who they're for, best match first.

GPUStack — Unifies AI model serving and GPU compute management across heterogeneous hardware. (Code, Free)
Reflex — It is optimized for cold-start latency and single-tenant decisions. (Code, Free)
fal — Access 1,000+ generative models and high-performance serverless GPUs. (Code, Paid)
Infernix — Serves massive Qwen models quickly on a single consumer GPU with advanced caching. (Code, Free)
LMDeploy — Accelerates inference with high-performance engines and quantization tools. (Code, Free)
ncnn — No runtime dependencies and supports CPU and Vulkan GPU backends. (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
TensorRT — Speeds up inference by 36X compared to CPU-only platforms. (Code, Free)
llm-d — Deploys production-grade LLM serving on existing hardware clusters. (Code, Free)
Strata — Runs large AI models locally on consumer gaming PCs without server reliance. (Code, Free)
Lumabri — Runs large AI models across multiple computers by sharing memory and layer workloads. (Code, Free)
Pulsar — It is the fastest inference engine for Qwen models on Apple Silicon. (Code, Free)