ort alternatives

The 12 products closest to ort in what they do and who they're for, best match first.

ncnn — No runtime dependencies and supports CPU and Vulkan GPU backends. (Code, Free)
TensorRT — Speeds up inference by 36X compared to CPU-only platforms. (Code, Free)
MNN — It delivers high-performance inference and training with a lightweight footprint. (Code, Free)
Resin — Builds high-performance inference engines for complex models like DeepSeek and GLM. (Code, Free)
oMLX — It uses paged SSD KV caching to reduce agent TTFT to under 5 seconds. (Code, Free)
Shimmy — Runs local AI models with zero Python or C++ dependencies. (Code, Free)
Enki LLM — Runs Llama-3.2 1B in pure Rust at 40 tok/s with live GPU to CPU migration. (Code, Free)
iwant — Spins up cloud GPUs and open models instantly via a single command. (Code, Free)
fal — Access 1,000+ generative models and high-performance serverless GPUs. (Code, Paid)
Foundry Local — Runs AI models locally on device with complete privacy and no Azure subscription. (Code, Free)
AirLLM — Runs massive 70B+ parameter models on small 4GB consumer GPUs. (Code, Free)
Neptune — It combines a fast native terminal engine with built-in management for AI coding agents. (Code, Free)